-- Logs begin at Wed 2022-01-05 13:59:35 UTC, end at Wed 2022-01-05 15:21:24 UTC. -- Jan 05 14:50:39.848245 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Jan 05 14:50:42.813692 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.common.config [-] Logging enabled! Jan 05 14:50:42.814316 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev330 Jan 05 14:50:42.814413 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=114543) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Jan 05 14:50:42.817745 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.common.config [-] Logging enabled! Jan 05 14:50:42.818000 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev330 Jan 05 14:50:42.818322 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=114543) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Jan 05 14:50:42.819218 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:50:42.819451 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:50:42.819978 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:50:42.820238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:50:42.820468 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:50:42.820822 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.821264 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Jan 05 14:50:42.821573 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.821884 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.822175 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.822466 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.822751 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.823030 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.823313 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.823606 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.823888 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.824165 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.824446 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.824732 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.825010 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] config_source = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.825322 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.825606 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.825888 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] debug = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.826164 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.826611 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.827034 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.827312 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.827598 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.827872 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.828142 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.828414 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.828693 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.829016 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] host = dv-cinder-master-3-iscsi {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.829341 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.829647 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.829930 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.830233 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.830505 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.830799 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.831083 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.831354 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] log_dir = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.831624 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] log_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.831894 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.832176 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.832457 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.832746 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.832968 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.833217 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.833525 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.833810 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.834082 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.834355 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.834628 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.834898 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.835170 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.835436 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.835717 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.836003 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.836281 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.836551 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.836820 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.837106 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.837378 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.837658 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.837928 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.838199 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.838469 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.838750 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.839015 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.839286 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.839581 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.839861 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.840139 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.840444 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.840715 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.840994 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.841285 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.841554 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] use_journal = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.841820 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] use_json = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.842086 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.842350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.842625 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.842891 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.843156 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.843422 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.843687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.843964 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:42.844253 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.844542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.845372 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.845664 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.845955 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.846237 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.846522 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.846799 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.847082 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.847366 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.847652 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.847927 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.848222 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.848505 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.848792 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.849117 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.849411 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.849700 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.849972 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.850243 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.850513 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.850787 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.851069 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.851344 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.851625 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.851908 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.852216 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.852509 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.852793 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.853099 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.853391 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.853662 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.853938 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.854226 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.854500 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.854768 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.855040 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.855327 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.855603 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.855873 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.856156 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.856466 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.856718 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.856983 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.857280 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.857565 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.857837 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.858103 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.858370 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.858642 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.858907 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.859188 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.859458 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.859728 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.859994 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.860284 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.860555 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.861414 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.861697 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.861969 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.862244 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.862515 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.862786 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.863056 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.863329 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.863601 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.863872 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.864144 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.864419 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.864692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.864963 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.865262 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.865539 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.865832 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.866125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.866421 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.866697 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.866974 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.867250 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.867525 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.867797 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.868333 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.868607 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.868879 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.869174 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.869460 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.869739 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.870023 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.870300 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.870602 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.870892 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.871164 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.871440 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.871714 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.871989 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.872286 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.872564 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.872852 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.873178 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.873468 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.873755 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.874041 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.874314 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.874616 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.874905 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:42.875122 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:50:42.875357 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=114543) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Jan 05 14:50:43.224187 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=114543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:50:43.224464 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=114543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:50:43.224767 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=114543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 05 14:50:43.225117 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [-] Loading core plugin: ml2 Jan 05 14:50:43.553142 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.553447 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.553731 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.555027 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.555300 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.555564 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.601606 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.601887 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.602151 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.616119 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.616402 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.616672 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.646022 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.646306 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.646585 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.683577 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.683852 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:43.684118 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.019840 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.020472 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.020472 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.020657 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.021376 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.120923 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.121266 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.121548 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.121818 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.122082 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.122399 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.122664 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.122916 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.123164 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.123442 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.123697 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.123958 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.124210 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.124462 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.124716 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.124979 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.125255 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.125522 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.125787 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.126069 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.126340 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.126589 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.126863 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.127234 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.127479 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.127720 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.128107 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:44.128345 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:44.128579 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:44.128827 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:44.129080 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:44.129322 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:44.129683 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Jan 05 14:50:44.132958 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Jan 05 14:50:44.136910 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Jan 05 14:50:44.140907 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(100, 149)])]) Jan 05 14:50:44.142594 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Jan 05 14:50:44.143053 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Jan 05 14:50:44.143383 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Jan 05 14:50:44.143762 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Jan 05 14:50:44.146609 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Jan 05 14:50:44.146862 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Jan 05 14:50:44.147223 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Jan 05 14:50:44.152739 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Jan 05 14:50:44.176560 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Jan 05 14:50:44.177002 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.177318 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=114543) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Jan 05 14:50:44.177678 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.179053 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=114543) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Jan 05 14:50:44.179333 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Jan 05 14:50:44.179576 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Jan 05 14:50:44.182836 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.183119 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:44.247041 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Jan 05 14:50:44.247277 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Jan 05 14:50:44.247512 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Jan 05 14:50:44.247870 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Jan 05 14:50:44.267727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_db.sqlalchemy.engines [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 14:50:44.870327 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing driver for type 'gre' Jan 05 14:50:44.870858 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] gre ID ranges: [(1, 1000)] Jan 05 14:50:45.078832 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing driver for type 'local' Jan 05 14:50:45.080004 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing driver for type 'vlan' Jan 05 14:50:45.153272 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] VlanTypeDriver initialization complete Jan 05 14:50:45.153541 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing driver for type 'vxlan' Jan 05 14:50:45.154068 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] vxlan ID ranges: [(1, 1000)] Jan 05 14:50:45.378605 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing extension driver 'port_security' Jan 05 14:50:45.378962 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.extensions.port_security [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] PortSecurityExtensionDriver initialization complete Jan 05 14:50:45.379293 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing mechanism driver 'openvswitch' Jan 05 14:50:45.379613 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing mechanism driver 'hyperv' Jan 05 14:50:45.391604 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.plugin [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=114543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:50:45.392317 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.392689 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.393042 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.393601 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=114543) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Jan 05 14:50:45.394028 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnet after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.394378 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnet after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.394720 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnet after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.395122 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=114543) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Jan 05 14:50:45.395547 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.395922 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.396265 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.396654 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=114543) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Jan 05 14:50:45.397054 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > security_group after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.397423 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > security_group after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.397797 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > security_group after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.398327 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=114543) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Jan 05 14:50:45.398734 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.399083 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.399424 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.399816 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=114543) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Jan 05 14:50:45.400213 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > address_group after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.400557 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > address_group after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.400889 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > address_group after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.401334 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=114543) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Jan 05 14:50:45.401742 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] ML2 OVO RPC backend initialized. {{(pid=114543) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Jan 05 14:50:45.402439 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router_interface after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.402792 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.403223 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.403613 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > networks before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.403915 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.404252 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > ports before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.404592 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnet before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.404928 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnets before_response 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.405295 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.405634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.405965 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.406296 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.406627 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.406958 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.407288 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnet after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.407638 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnet after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.407968 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > subnet after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.408540 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.plugin [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Modular L2 Plugin initialization complete Jan 05 14:50:45.408868 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading services supported by the core plugin {{(pid=114543) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Jan 05 14:50:45.409259 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.plugins.ml2.managers [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Got port-security extension from driver 'port_security' Jan 05 14:50:45.409717 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.extensions.vlantransparent [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Disabled vlantransparent extension. Jan 05 14:50:45.410188 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=114543) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Jan 05 14:50:45.410501 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: router Jan 05 14:50:45.448994 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router_interface before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.449412 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router after_create 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.449782 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router before_create 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.450145 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router_interface before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.450520 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.450872 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router after_delete 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.451251 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > floatingip after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.451613 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > floatingip after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.452035 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router after_create 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.452340 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router after_update 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.452687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router after_update 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.453036 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.453419 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router after_update 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.453850 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_update 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.454259 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: port after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.454602 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: port after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.454940 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: subnet after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.455275 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.455622 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > port precommit_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.455977 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_create 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.456333 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: port before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.456674 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.457029 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router after_update 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.457400 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_delete 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.457751 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_create 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.458130 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router_interface after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.458474 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_update 55549900 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.458856 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > agent after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.459203 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > agent after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.459562 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > network after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.460428 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Tracking information for resource: router configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:45.460767 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Tracking information for resource: floatingip configured {{(pid=114543) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jan 05 14:50:45.467720 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.db.l3_agentschedulers_db [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Jan 05 14:50:45.468300 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: port after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.468665 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: port after_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.469019 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: port after_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.469419 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: port after_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.470222 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router before_create 55550100 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.470585 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_delete 55550100 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.470942 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_create 55550100 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.471295 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > router precommit_update 55550100 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.476047 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.services.provider_configuration [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service providers = [] {{(pid=114543) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Jan 05 14:50:45.476415 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.db.servicetype_db [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=114543) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Jan 05 14:50:45.479375 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.services.service_base [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=114543) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jan 05 14:50:45.479724 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.services.service_base [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=114543) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jan 05 14:50:45.480066 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.services.service_base [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=114543) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jan 05 14:50:45.480967 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.services.service_base [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=114543) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jan 05 14:50:45.481363 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.services.service_base [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Default provider is not specified for service type L3_ROUTER_NAT Jan 05 14:50:45.481726 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.482041 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Jan 05 14:50:45.493518 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded METERING plugin. Description: METERING {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.493853 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: auto_allocate Jan 05 14:50:45.499736 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: network precommit_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.500124 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: network precommit_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.500668 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.500990 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: tag Jan 05 14:50:45.508309 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.508645 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: timestamp Jan 05 14:50:45.512750 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.513102 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: network_ip_availability Jan 05 14:50:45.522939 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.523330 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.523691 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.524413 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.524738 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: flavors Jan 05 14:50:45.529693 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.530026 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading Plugin: revisions Jan 05 14:50:45.534923 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=114543) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jan 05 14:50:45.535317 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_concurrency.lockutils [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.310s {{(pid=114543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 05 14:50:45.536058 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=114543) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Jan 05 14:50:45.536390 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Initializing extension manager. Jan 05 14:50:45.536912 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: __init__.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.537281 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: __pycache__ {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.537620 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.537954 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: address_group.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.538731 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.539330 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: address-group Jan 05 14:50:45.539655 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: address_scope.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.540557 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.541093 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: address-scope Jan 05 14:50:45.541423 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: admin_state_down_before_update.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.542354 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.542873 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: router-admin-state-down-before-update Jan 05 14:50:45.543203 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: agent.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.543933 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.544448 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: agent Jan 05 14:50:45.544771 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: agent_resources_synced.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.545707 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.546223 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: agent-resources-synced Jan 05 14:50:45.546548 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: allowedaddresspairs.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.549059 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.549604 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: allowed-address-pairs Jan 05 14:50:45.549932 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: auto_allocated_topology.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.551010 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.551526 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: auto-allocated-topology Jan 05 14:50:45.551853 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: availability_zone.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.552547 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.553055 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: availability_zone Jan 05 14:50:45.553430 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: availability_zone_filter.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.554353 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.554898 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: availability_zone_filter Jan 05 14:50:45.555221 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: data_plane_status.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.556115 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.556623 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension data-plane-status not supported by any of loaded plugins Jan 05 14:50:45.556945 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: default_subnetpools.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.557877 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.558383 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: default-subnetpools Jan 05 14:50:45.558704 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: dhcpagentscheduler.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.559508 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.560025 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: dhcp_agent_scheduler Jan 05 14:50:45.560370 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: dns.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.561344 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.561855 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension dns-integration not supported by any of loaded plugins Jan 05 14:50:45.562176 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: dns_domain_ports.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.563087 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.563640 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension dns-domain-ports not supported by any of loaded plugins Jan 05 14:50:45.563962 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.570883 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.571386 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Jan 05 14:50:45.571707 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: dvr.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.572373 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.572878 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: dvr Jan 05 14:50:45.573232 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: ecmp_routes.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.574141 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.574692 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension ecmp_routes not supported by any of loaded plugins Jan 05 14:50:45.575015 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: empty_string_filtering.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.575918 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.576425 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: empty-string-filtering Jan 05 14:50:45.576746 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.577700 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.578213 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Jan 05 14:50:45.578537 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.579483 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.579985 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Jan 05 14:50:45.580304 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: external_net.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.581281 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.581791 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: external-net Jan 05 14:50:45.582108 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: extra_dhcp_opt.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.583036 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.583540 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: extra_dhcp_opt Jan 05 14:50:45.583859 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: extraroute.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.584760 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.585337 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: extraroute Jan 05 14:50:45.585660 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: extraroute_atomic.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.586707 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.587217 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: extraroute-atomic Jan 05 14:50:45.587536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: filter_validation.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.588196 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.588698 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: filter-validation Jan 05 14:50:45.589018 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: fip_pf_description.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.589950 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.590452 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Jan 05 14:50:45.590770 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: fip_port_details.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.591703 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.592210 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: fip-port-details Jan 05 14:50:45.592530 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: flavors.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.593799 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.594325 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: flavors Jan 05 14:50:45.594650 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.596877 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.597429 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Jan 05 14:50:45.597759 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: floatingip_pools.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.598458 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.598973 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: floatingip-pools Jan 05 14:50:45.599297 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: ip_allocation.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.600228 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.600781 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension ip_allocation not supported by any of loaded plugins Jan 05 14:50:45.601137 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: ip_substring_port_filtering.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.602060 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.602581 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: ip-substring-filtering Jan 05 14:50:45.602907 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l2_adjacency.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.604046 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.604564 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension l2_adjacency not supported by any of loaded plugins Jan 05 14:50:45.604888 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l3.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.606103 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.606642 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: router Jan 05 14:50:45.606999 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l3_conntrack_helper.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.617346 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.618185 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension l3-conntrack-helper not supported by any of loaded plugins Jan 05 14:50:45.618583 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l3_ext_gw_mode.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.619515 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.620027 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: ext-gw-mode Jan 05 14:50:45.620371 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l3_ext_ha_mode.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.621412 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.621925 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: l3-ha Jan 05 14:50:45.622249 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l3_flavors.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.623230 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.623741 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: l3-flavors Jan 05 14:50:45.624064 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.625032 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.625566 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: l3-port-ip-change-not-allowed Jan 05 14:50:45.625912 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: l3agentscheduler.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.627077 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.627635 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: l3_agent_scheduler Jan 05 14:50:45.627965 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: local_ip.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.629772 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.630295 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension local_ip not supported by any of loaded plugins Jan 05 14:50:45.630624 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: logging.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.632158 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.632679 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension logging not supported by any of loaded plugins Jan 05 14:50:45.633008 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: metering.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.633779 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.634361 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: metering Jan 05 14:50:45.634682 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.635778 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.636301 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: metering_source_and_destination_fields Jan 05 14:50:45.636627 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: multiprovidernet.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.637617 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.638137 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: multi-provider Jan 05 14:50:45.638461 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: netmtu.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.639379 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.639979 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: net-mtu Jan 05 14:50:45.640308 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: netmtu_writable.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.641257 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.641815 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: net-mtu-writable Jan 05 14:50:45.642147 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: network_availability_zone.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.642817 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.643345 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: network_availability_zone Jan 05 14:50:45.643696 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: network_ip_availability.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.644811 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.645359 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: network-ip-availability Jan 05 14:50:45.645683 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: network_segment_range.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.646487 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.646994 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension network-segment-range not supported by any of loaded plugins Jan 05 14:50:45.647315 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: pagination.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.648458 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.648791 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: pagination Jan 05 14:50:45.649144 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: port_device_profile.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.650083 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.650607 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: port-device-profile Jan 05 14:50:45.650932 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: port_mac_address_regenerate.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.651870 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.652387 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: port-mac-address-regenerate Jan 05 14:50:45.652711 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: port_numa_affinity_policy.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.653717 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.654190 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: port-numa-affinity-policy Jan 05 14:50:45.654510 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: port_resource_request.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.655411 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.655915 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension port-resource-request not supported by any of loaded plugins Jan 05 14:50:45.656234 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: port_resource_request_groups.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.657237 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.658274 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension port-resource-request-groups not supported by any of loaded plugins Jan 05 14:50:45.658594 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: portbindings.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.659518 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.660029 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: binding Jan 05 14:50:45.660395 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: portbindings_extended.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.661704 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.662218 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: binding-extended Jan 05 14:50:45.662546 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: portsecurity.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.663469 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.664008 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: port-security Jan 05 14:50:45.664332 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: project_id.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.665331 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.665659 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: project-id Jan 05 14:50:45.665979 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: providernet.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.666889 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.667402 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: provider Jan 05 14:50:45.667724 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.671417 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.672379 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos not supported by any of loaded plugins Jan 05 14:50:45.672379 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_bw_limit_direction.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.674202 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.674719 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Jan 05 14:50:45.675048 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.676008 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.676521 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Jan 05 14:50:45.676848 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_default.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.677783 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.678303 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-default not supported by any of loaded plugins Jan 05 14:50:45.678628 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_fip.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.679275 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.679781 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-fip not supported by any of loaded plugins Jan 05 14:50:45.680103 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_fip_network_policy.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.681036 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.681565 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-fip-network-policy not supported by any of loaded plugins Jan 05 14:50:45.681889 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_gateway_ip.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.682800 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.683308 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-gateway-ip not supported by any of loaded plugins Jan 05 14:50:45.683633 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_port_network_policy.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.684576 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.685102 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-port-network-policy not supported by any of loaded plugins Jan 05 14:50:45.685431 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.686491 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.687005 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-pps-minimum not supported by any of loaded plugins Jan 05 14:50:45.687331 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_pps_rule.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.688559 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.689098 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-pps not supported by any of loaded plugins Jan 05 14:50:45.689429 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_rule_type_details.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.690344 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.690879 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-rule-type-details not supported by any of loaded plugins Jan 05 14:50:45.691204 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: qos_rules_alias.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.692295 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.692829 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension qos-rules-alias not supported by any of loaded plugins Jan 05 14:50:45.693190 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: quota_check_limit.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.694105 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.694622 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: quota-check-limit Jan 05 14:50:45.694985 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: quotasv2.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.695919 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.696245 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: quotas Jan 05 14:50:45.696565 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: quotasv2_detail.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.700054 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.700393 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: quota_details Jan 05 14:50:45.700725 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: rbac.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.701817 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.702380 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: rbac-policies Jan 05 14:50:45.702712 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: rbac_address_group.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.703659 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.704207 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: rbac-address-group Jan 05 14:50:45.704540 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: rbac_address_scope.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.713761 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.714278 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: rbac-address-scope Jan 05 14:50:45.714606 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: rbac_security_groups.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.715517 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.716039 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: rbac-security-groups Jan 05 14:50:45.716371 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: rbac_subnetpool.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.717333 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.717852 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: rbac-subnetpool Jan 05 14:50:45.718177 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: revisionifmatch.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.719105 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.719622 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: revision-if-match Jan 05 14:50:45.720468 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: revisions.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.721589 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.722103 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: standard-attr-revisions Jan 05 14:50:45.722430 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: router_availability_zone.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.723110 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.723703 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: router_availability_zone Jan 05 14:50:45.724028 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: routerservicetype.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.724941 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.725495 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension router-service-type not supported by any of loaded plugins Jan 05 14:50:45.725819 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.726833 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.727345 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: security-groups-normalized-cidr Jan 05 14:50:45.727667 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: security_groups_port_filtering.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.728593 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.729129 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: port-security-groups-filtering Jan 05 14:50:45.729459 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: security_groups_remote_address_group.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.730384 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.730898 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: security-groups-remote-address-group Jan 05 14:50:45.731222 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: security_groups_shared_filtering.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.732181 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.732696 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: security-groups-shared-filtering Jan 05 14:50:45.733018 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.733623 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Jan 05 14:50:45.733944 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: securitygroup.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.745903 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.746438 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: security-group Jan 05 14:50:45.746779 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: segment.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.747564 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.748098 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension segment not supported by any of loaded plugins Jan 05 14:50:45.748428 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.749442 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.749958 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Jan 05 14:50:45.750284 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: servicetype.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.751406 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.751929 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: service-type Jan 05 14:50:45.752254 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: sorting.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.753267 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.753601 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: sorting Jan 05 14:50:45.753924 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: standard_attr_segment.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.754868 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.755380 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension standard-attr-segment not supported by any of loaded plugins Jan 05 14:50:45.755702 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: standardattrdescription.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.756360 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.756877 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: standard-attr-description Jan 05 14:50:45.757232 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: stateful_security_group.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.758176 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.758692 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: stateful-security-group Jan 05 14:50:45.759019 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: stdattrs_common.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.759604 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Jan 05 14:50:45.759929 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.760860 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.761411 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Jan 05 14:50:45.761738 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: subnet_onboard.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.762804 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.763321 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: subnet_onboard Jan 05 14:50:45.763647 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: subnet_segmentid_writable.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.764563 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.765113 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Jan 05 14:50:45.765441 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: subnet_service_types.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.766392 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.766925 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: subnet-service-types Jan 05 14:50:45.767249 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: subnetallocation.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.768331 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.768846 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: subnet_allocation Jan 05 14:50:45.769206 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.769866 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.770374 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: subnetpool-prefix-ops Jan 05 14:50:45.770695 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.771641 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.772168 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Jan 05 14:50:45.772512 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: tagging.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.773598 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.774136 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: standard-attr-tag Jan 05 14:50:45.774463 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: timestamp.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.781900 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.782946 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loaded extension: standard-attr-timestamp Jan 05 14:50:45.783277 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: trunk.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.784331 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.784850 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension trunk not supported by any of loaded plugins Jan 05 14:50:45.785219 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: trunk_details.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.786172 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.786687 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension trunk-details not supported by any of loaded plugins Jan 05 14:50:45.787012 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: uplink_status_propagation.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.787929 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.788438 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension uplink-status-propagation not supported by any of loaded plugins Jan 05 14:50:45.788762 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Loading extension file: vlantransparent.py {{(pid=114543) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Jan 05 14:50:45.789454 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=114543) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Jan 05 14:50:45.789964 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extension vlan-transparent not supported by any of loaded plugins Jan 05 14:50:45.792514 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:network Jan 05 14:50:45.793078 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:subnet Jan 05 14:50:45.793483 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:subnetpool Jan 05 14:50:45.793897 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:port Jan 05 14:50:45.795110 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.795556 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service FLAVORS assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.796156 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.796579 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.796912 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:router Jan 05 14:50:45.797383 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:floatingip Jan 05 14:50:45.798487 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service METERING assigned prefix: /metering {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.799948 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.800328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.800680 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 14:50:45.801698 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of CountableResource for resource:rbac_policy Jan 05 14:50:45.802153 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:security_group Jan 05 14:50:45.802591 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:security_group_rule Jan 05 14:50:45.803216 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service CORE assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.803555 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:subnetpool Jan 05 14:50:45.803901 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] subnetpool is already registered Jan 05 14:50:45.804335 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service CORE assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.804663 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:subnetpool Jan 05 14:50:45.805019 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] subnetpool is already registered Jan 05 14:50:45.807279 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.807709 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service FLAVORS assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.808291 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.808728 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.809080 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:router Jan 05 14:50:45.811112 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] router is already registered Jan 05 14:50:45.811112 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:floatingip Jan 05 14:50:45.811112 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] floatingip is already registered Jan 05 14:50:45.811112 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service METERING assigned prefix: /metering {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.811386 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of CountableResource for resource:rbac_policy Jan 05 14:50:45.811578 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] rbac_policy is already registered Jan 05 14:50:45.811988 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:security_group Jan 05 14:50:45.812321 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] security_group is already registered Jan 05 14:50:45.812726 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:security_group_rule Jan 05 14:50:45.813074 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] security_group_rule is already registered Jan 05 14:50:45.813767 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service CORE assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.814101 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:subnetpool Jan 05 14:50:45.814436 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] subnetpool is already registered Jan 05 14:50:45.814909 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.v2.resource_helper [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Service CORE assigned prefix: {{(pid=114543) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jan 05 14:50:45.815239 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Creating instance of TrackedResource for resource:subnetpool Jan 05 14:50:45.815572 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING neutron.quota.resource_registry [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] subnetpool is already registered Jan 05 14:50:45.816034 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: extensions {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.817522 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: address-groups {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.819003 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: address-scopes {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.820357 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: agents {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.821553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: auto-allocated-topology {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.822829 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: availability_zones {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.824095 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: dhcp-networks {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.825619 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: dhcp-agents {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.827069 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: routers {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.829333 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: flavors {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.830481 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: service_profiles {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.831664 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: next_providers {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.833106 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: service_profiles {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.834765 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: floatingip-pools {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.835981 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: routers {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.838107 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: floatingips {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.839411 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: l3-routers {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.840797 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: l3-agents {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.842264 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: metering-labels {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.843614 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: metering-label-rules {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.845423 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: network-ip-availabilities {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.846796 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: bindings {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.849277 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: quotas {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.850905 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: quotas {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.852500 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: rbac-policies {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.853820 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: security-groups {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.855042 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: security-group-rules {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.856267 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: service-providers {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.857574 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: subnetpools {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.859017 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: subnetpools {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.861052 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.862765 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.864642 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.866441 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.868497 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.870416 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.872100 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.874058 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.875876 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.877826 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron.api.extensions [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Extended resource: tags {{(pid=114543) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jan 05 14:50:45.883731 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING keystonemiddleware.auth_token [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 14:50:45.888373 dv-cinder-master-3-iscsi neutron-server[114543]: WARNING keystonemiddleware.auth_token [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 14:50:45.897391 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_concurrency.lockutils [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Acquired lock "singleton_lock" {{(pid=114543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 05 14:50:45.897940 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_concurrency.lockutils [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Releasing lock "singleton_lock" {{(pid=114543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 05 14:50:45.898589 dv-cinder-master-3-iscsi neutron-server[114543]: INFO oslo_service.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Starting 2 workers Jan 05 14:50:45.903559 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Started child 114654 {{(pid=114543) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jan 05 14:50:45.909177 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Started child 114655 {{(pid=114543) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jan 05 14:50:45.910693 dv-cinder-master-3-iscsi neutron-server[114543]: INFO neutron.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Neutron service started, listening on 0.0.0.0:9696 Jan 05 14:50:45.911425 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Publish callbacks [] for process, before_spawn {{(pid=114543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:50:45.914018 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:50:45.914714 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:50:45.915100 dv-cinder-master-3-iscsi neutron-server[114543]: INFO oslo_service.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Starting 1 workers Jan 05 14:50:45.915177 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [-] (114654) wsgi starting up on http://0.0.0.0:9696 Jan 05 14:50:45.915245 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [-] (114655) wsgi starting up on http://0.0.0.0:9696 Jan 05 14:50:45.919552 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Started child 114656 {{(pid=114543) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jan 05 14:50:45.927107 dv-cinder-master-3-iscsi neutron-server[114543]: INFO oslo_service.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Starting 1 workers Jan 05 14:50:45.927107 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Started child 114657 {{(pid=114543) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jan 05 14:50:45.927107 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG neutron_lib.callbacks.manager [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] Publish callbacks [] for process, after_spawn {{(pid=114543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:50:45.927364 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] calling RpcWorker wait() {{(pid=114656) _wait /opt/stack/neutron/neutron/service.py:128}} Jan 05 14:50:45.927364 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.service [None req-d85b411d-4ebf-44fb-85ed-2e8c89484d3a None None] returning from RpcWorker wait() {{(pid=114656) _wait /opt/stack/neutron/neutron/service.py:135}} Jan 05 14:50:45.927886 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=114543) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jan 05 14:50:45.927886 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:50:45.927886 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:50:45.928076 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:50:45.928141 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:50:45.928362 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:50:45.928463 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:50:45.928533 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:50:45.928902 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.929215 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.929491 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.929767 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.929985 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:50:45.930402 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.930627 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.930902 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.931154 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.931255 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:50:45.931438 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.931668 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.931836 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.932022 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.932298 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.932542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.932839 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.933139 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.933388 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.933648 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.933817 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.934065 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config_source = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.934323 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.934571 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.934826 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] debug = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.935087 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.935573 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.935803 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.936041 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.936255 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.936540 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.936765 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.937027 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.937312 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.937548 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.937793 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.938042 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.938311 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.938569 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.938863 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.939098 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.939351 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.939588 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.940065 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] host = dv-cinder-master-3-iscsi {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.940303 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.940520 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.940764 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.941022 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.941303 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.941518 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.941767 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.942025 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.942267 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.942515 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.942778 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.943081 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.943246 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_dir = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.943536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.943869 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_options = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.944094 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.944377 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.944637 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.944838 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.945007 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.945193 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.945457 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.945633 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.945870 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.946135 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.946294 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.946535 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.946779 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.947020 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.947280 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.947507 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.947721 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.947928 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.948182 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.948406 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.948628 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.948867 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.949121 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.949361 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.949597 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.949845 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.950087 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.950302 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.950570 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.950815 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.951082 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.951422 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.951692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.952019 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.952295 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.952525 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.952975 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.953143 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.953711 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.954666 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.955018 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.955219 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.955628 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.955775 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.955955 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.956217 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_journal = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.956453 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_json = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.956669 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.956906 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.957484 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.957996 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.958581 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.958825 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.959051 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.959293 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:45.959725 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.960088 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.960434 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.960787 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.961054 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.961321 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.963137 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.963428 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.963713 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.963978 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.964668 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.965094 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.965480 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.965865 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.967686 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.967909 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.968436 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.968436 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.968694 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.969438 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.969438 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.969438 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.970736 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.970736 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.970973 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.971231 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.971487 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.971806 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.972095 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.972711 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.972711 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.972988 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.30/identity {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.973279 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.973535 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.973765 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.974016 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.974267 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.974497 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.974723 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.975010 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.975256 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.975503 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.975735 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.975982 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.976232 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.976473 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.976697 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.976956 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.977235 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.977480 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.977726 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.977964 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.978187 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.978542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.978678 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.979039 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.979187 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.979382 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.979622 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.979840 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.980081 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.980303 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.981099 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.981099 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.981099 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.981371 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.981503 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.981717 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.981980 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.982195 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.982415 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.982631 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.982844 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.983052 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.983291 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.983515 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.983732 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.984103 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.984466 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.984689 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.984918 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.985159 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.985376 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.985593 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.985807 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.986027 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.986255 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.986487 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.986701 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.986934 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.987167 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.987450 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.987770 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.988021 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.988281 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.988503 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.988744 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.988968 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.989226 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.989445 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.989665 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.989883 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.990168 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.990360 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.990612 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.990883 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.991119 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.991372 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.991591 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.991811 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.992049 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.992287 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.992530 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.993045 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.993301 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.993534 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.993765 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.994016 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.994284 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.994541 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.994819 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.995038 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.995300 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.995609 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.995871 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.996126 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.996389 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.996652 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.996918 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.997193 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.997444 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.997694 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.997980 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.998223 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.998468 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.998687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.998928 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.999178 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.999486 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.999722 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:45.999953 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.000166 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.000466 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.000714 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.000959 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.001247 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.001494 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.001727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.001992 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.002254 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.30/identity {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.002470 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.002704 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.002935 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.003149 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.003384 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.003617 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.003835 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.004050 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.004264 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.004504 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.004734 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.004958 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.005232 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.005453 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.005670 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.005918 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.006133 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.006357 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.006577 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.006828 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.007069 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.007284 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.007498 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.007749 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.007967 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.008233 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.008485 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.008702 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.008933 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.009207 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.009445 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.009661 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.009904 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.010123 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.010355 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.010590 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.010807 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.011043 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.011255 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.011481 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.011693 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.011923 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.012181 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.012503 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.012750 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.012985 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.013272 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.013489 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.013738 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.013972 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.014190 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.014425 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.014639 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.014883 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.015138 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.015388 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.015640 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.015852 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.016081 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.016292 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.016507 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.017243 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.017560 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.017816 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.018048 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.018305 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.018564 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.018784 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.019016 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.019238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.019456 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.019678 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.019911 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.020112 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.020340 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.020575 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.020810 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.021030 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.024692 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025238 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025927 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.025995 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.026220 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.026514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.026744 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.027003 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.027260 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.027583 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.027830 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.028088 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.028324 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.028543 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.028769 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.029048 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.029747 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39644) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:50:46.033336 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.033690 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.033981 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.034245 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.034528 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.034829 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.035113 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.035348 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.035717 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.036276 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.036567 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.036833 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.037113 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.038536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.038536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.038536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.038536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.038536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.038536 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.039753 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.039753 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.039927 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [-] 10.222.0.30 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0071867 Jan 05 14:50:46.040000 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.040000 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.040000 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.040229 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.040552 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.040924 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.041317 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.041678 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.042007 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:50:46.042534 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=114543) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jan 05 14:50:46.042700 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 14:50:46.042855 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 14:50:46.043028 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 14:50:46.043197 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 14:50:46.043356 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 14:50:46.043566 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.043728 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.043891 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.044062 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.044201 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.044532 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.044704 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.044849 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.044991 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.045176 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.046387 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.047144 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.047312 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.047984 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.048148 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.048462 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.048759 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.049103 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.049290 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.050742 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] config_source = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.050994 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.052030 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.052214 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] debug = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.052392 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.052605 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.052798 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.052957 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.053807 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.053807 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.055185 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.055413 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.057101 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.057290 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.057461 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.057637 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.057808 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.057975 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.058142 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.058311 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.058455 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.058609 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.058772 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] host = dv-cinder-master-3-iscsi {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.058933 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.059092 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.059249 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.059406 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.059562 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.059719 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.059874 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.060031 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.060185 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.060340 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.060496 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.060651 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.060806 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_dir = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.060961 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.063257 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_options = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.064560 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.064746 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.064927 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.065151 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.065334 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.065510 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.065678 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.065849 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.066017 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.066181 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.066342 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.066500 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.066652 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.066811 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.066973 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.067169 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.067280 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.067440 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.067594 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.067750 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.067908 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.068062 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.068219 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.068374 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.068530 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.068687 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.068843 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.068998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.069365 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073195 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073195 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073195 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073420 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073586 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073674 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073843 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.073988 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.074152 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.074999 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.075390 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.076479 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.076479 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.078854 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_journal = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_json = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.080727 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.081250 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.081250 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.081250 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.081433 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 14:50:46.081433 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.081659 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.081776 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.081937 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.082097 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.083103 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.083270 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.084050 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.085291 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.086614 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.086809 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.086990 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.087406 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.087587 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.087758 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.089158 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.089695 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.089695 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.089695 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.090023 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.090129 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.090235 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.090386 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.090854 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.090854 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.090854 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.091171 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.091171 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.091372 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.091513 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.091677 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.091842 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.30/identity {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.092006 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.092189 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.093043 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.093275 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.093479 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.093609 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.093769 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.093931 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.094084 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096514 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.096998 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.097395 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.097395 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.097526 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.097651 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098372 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098372 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098372 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098372 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098644 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098644 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098802 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.098980 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.099134 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.099313 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.099467 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.099614 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.099768 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.099913 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.100069 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.100235 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.100395 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.100553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.100714 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.100878 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.101046 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.101222 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.101384 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.101552 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.101696 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.101849 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.102006 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.102153 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.102289 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.102445 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.102608 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.102780 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.103058 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.103227 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.103378 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:50:46.103530 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.103530 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.103788 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.103923 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.104067 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.104210 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.104344 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.104486 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.104622 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.104781 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.104949 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.105161 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.105317 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.105453 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.105617 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.105778 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.105940 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.106091 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.106234 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.107432 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.107432 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.107723 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.107723 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.107981 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.107981 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.108236 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.108421 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.108668 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.108668 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109007 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109007 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109303 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109303 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109451 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109609 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109782 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.109933 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.110081 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.110407 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.110733 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.110902 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.111068 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.112350 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.30/identity {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.113630 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.114643 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.114643 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.114643 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.114643 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.114643 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.114643 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.114643 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.115230 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.115230 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.115230 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.115445 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.115445 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.116545 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.116545 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.116545 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.116545 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.116545 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.116545 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.116545 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.117447 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.117447 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.117447 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.117447 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.117447 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.117447 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.118443 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.118443 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.118443 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.118443 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.119471 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.119665 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120188 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120188 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120188 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120398 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120478 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120654 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120801 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.120955 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.121145 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.121343 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.121528 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.121730 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.122232 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.122232 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.122232 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.122702 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.122702 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.122702 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.123074 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.123074 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.123074 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.123459 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.123603 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.123739 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.123873 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124015 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124149 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124282 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124414 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124547 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124680 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124846 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.124997 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.125197 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.125359 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.125552 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.125696 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.125831 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.126014 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.126179 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.126346 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.126486 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.126648 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.126808 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.126968 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.127129 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.127289 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.127459 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.127620 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.127768 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.127928 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.128088 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.128248 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.128496 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.128654 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.128789 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.128922 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.129823 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.129823 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.129823 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.129823 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.129823 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.129823 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.131542 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.132634 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.135125 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.136328 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.137553 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.138683 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.138683 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.138683 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 14:50:46.138683 dv-cinder-master-3-iscsi neutron-server[114543]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=114543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 14:50:58.114963 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f54063e1-c429-4a61-bd9a-a999b30643d4 None None] get_active_networks_info from dv-cinder-master-3-iscsi {{(pid=114656) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Jan 05 14:50:58.169541 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f54063e1-c429-4a61-bd9a-a999b30643d4 None None] No non-hosted networks {{(pid=114656) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Jan 05 14:50:58.184336 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.agentschedulers_db [None req-f54063e1-c429-4a61-bd9a-a999b30643d4 None None] DHCP Agent not found on host dv-cinder-master-3-iscsi {{(pid=114656) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Jan 05 14:50:58.291463 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3dfc2cb1-4b50-492b-8ff2-192ac107a838 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-713545'] for agent, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:00.449749 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-55af874a-cb66-4fa2-ab54-67b459fa4ed4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-713545'] for agent, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:00.496930 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.db.api [None req-4da94cc9-8325-489a-ae45-35ad7bd87127 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-master-3-iscsi {{(pid=114656) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jan 05 14:51:00.497745 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG oslo_db.api [None req-4da94cc9-8325-489a-ae45-35ad7bd87127 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jan 05 14:51:01.104804 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4da94cc9-8325-489a-ae45-35ad7bd87127 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:01.790598 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-713545'] for agent, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:02.724292 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-713545'] for agent, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:04.395847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-713545'] for agent, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:04.398130 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.399086 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.399639 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.400374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.401215 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.401928 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.402776 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.403488 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.404629 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.405295 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.409671 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.411861 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.411861 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:04.411861 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-master-3-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:04.430552 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-master-3-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:06.248736 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.db.l3_hamode_db [None req-612a9c98-a0a0-4e32-8a3e-42137772cac8 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Jan 05 14:51:06.331967 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-612a9c98-a0a0-4e32-8a3e-42137772cac8 None None] Routers set() bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:51:06.332265 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-612a9c98-a0a0-4e32-8a3e-42137772cac8 None None] Router IDs set() for agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Jan 05 14:51:07.428285 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39752) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:07.914476 dv-cinder-master-3-iscsi neutron-server[114654]: WARNING oslo_policy.policy [None req-63b72f12-9308-47d2-9c2a-d1c26f36b077 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:07.915067 dv-cinder-master-3-iscsi neutron-server[114654]: WARNING oslo_policy.policy [None req-63b72f12-9308-47d2-9c2a-d1c26f36b077 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:08.139497 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [None req-63b72f12-9308-47d2-9c2a-d1c26f36b077 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:51:08.140605 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-63b72f12-9308-47d2-9c2a-d1c26f36b077 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7113955 Jan 05 14:51:10.990739 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39768) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:11.281331 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] Request body: {'subnetpool': {'is_default': True, 'default_prefixlen': 26, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'tenant_id': 'df4f5a399f0847ef9e872ee655a1354c'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:51:11.383215 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.policy [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=114654) register_rules /opt/stack/neutron/neutron/policy.py:73}} Jan 05 14:51:11.428722 dv-cinder-master-3-iscsi neutron-server[114654]: WARNING oslo_policy.policy [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:11.429113 dv-cinder-master-3-iscsi neutron-server[114654]: WARNING oslo_policy.policy [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:11.437559 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.quota [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] Loaded quota_driver: . Jan 05 14:51:11.617991 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783775616768', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783775616471', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783775643776', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783775632820', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783775654642', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783775646298', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-4109877', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-4106936', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-527999', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-720955'] for rbac-policy, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:11.784283 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:11.785622 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f5ef7fab-8eb4-4895-acf8-261517523d50 admin admin] 10.222.0.30 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.7938700 Jan 05 14:51:14.654502 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39780) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:14.947800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Request body: {'network': {'name': 'private', 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'admin_state_up': True}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:51:15.035180 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Made reservation on behalf of 0c3d9801ad754740ae4b7891d05c103f for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:51:15.038036 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.054765 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.157723 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.194794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.213647 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 139} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 14:51:15.240843 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8783776153137', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.241432 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Unsubscribe: segment precommit_create {{(pid=114654) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Jan 05 14:51:15.241945 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Added segment 75010be9-322b-4960-8f4f-2babd4962cf1 of type vlan for network ab6d032f-85b6-459d-aedf-ac337806f73f Jan 05 14:51:15.259321 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6991985-53ab-4910-ba11-0352010e7434,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:15.305013 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.305327 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.305672 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.306007 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.306338 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.306667 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.307006 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.307332 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.307690 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.308016 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.308342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.308659 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.308980 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Tracked resource versions report: Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: pushed versions: Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: { 'AddressGroup': {'1.2'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'ConntrackHelper': {'1.0'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Log': {'1.0'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Network': {'1.1'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Port': {'1.7'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'PortForwarding': {'1.2'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'QosPolicy': {'1.10'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroup': {'1.5'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'SubPort': {'1.0'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Subnet': {'1.1'}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Trunk': {'1.1'}} Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: consumer versions: Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'ConntrackHelper': '1.0', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'LocalIPAssociation': '1.0', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Log': '1.0', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Network': '1.1', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Port': '1.7', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'PortForwarding': '1.2', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'QosPolicy': '1.10', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroup': '1.5', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroupRule': '1.2', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'SubPort': '1.0', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Subnet': '1.1', Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: 'Trunk': '1.1'}} Jan 05 14:51:15.310362 dv-cinder-master-3-iscsi neutron-server[114654]: {{(pid=114654) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:51:15.349427 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.426658 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.427736 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:15.428484 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:15.523154 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] Pushing event updated for resources: {'Network': ['ID=ab6d032f-85b6-459d-aedf-ac337806f73f,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:15.528537 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-ed0ca71d-f951-489c-b002-553c4a26f836 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8730419 Jan 05 14:51:15.534647 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network ab6d032f-85b6-459d-aedf-ac337806f73f details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 14:51:18.441299 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39794) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:18.831033 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b0e89b8-4797-47c8-b4c3-67d27fc137a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:18.832386 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7b0e89b8-4797-47c8-b4c3-67d27fc137a0 admin admin] 10.222.0.30 "GET /v2.0/networks/ab6d032f-85b6-459d-aedf-ac337806f73f HTTP/1.1" status: 200 len: 825 time: 0.3901205 Jan 05 14:51:18.856574 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-60bf6f10-7dc5-49bd-aa76-16d399e5e252 admin admin] 10.222.0.30 "GET /v2.0/subnetpools/dbf58974-bfe9-4253-a5b7-7953a1ccf866 HTTP/1.1" status: 200 len: 734 time: 0.0185368 Jan 05 14:51:18.865335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Request body: {'subnet': {'subnetpool_id': 'dbf58974-bfe9-4253-a5b7-7953a1ccf866', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'ip_version': 4, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:51:18.949412 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Made reservation on behalf of 0c3d9801ad754740ae4b7891d05c103f for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:51:18.951603 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:19.332542 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:19.402353 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe44b4c9-34b5-45df-a4d5-fa041d1f4de8,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:19.404319 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Checking segment: {'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:51:19.404695 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Network hostable DHCP agents. Network: ab6d032f-85b6-459d-aedf-ac337806f73f, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 14:51:19.469294 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Network ab6d032f-85b6-459d-aedf-ac337806f73f is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 14:51:19.540486 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, ab6d032f-85b6-459d-aedf-ac337806f73f) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:51:19.545093 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:19.545716 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:19.550000 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54de5e6a-eb91-4a4d-928a-801579e0308e None None] Network ab6d032f-85b6-459d-aedf-ac337806f73f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:51:19.617843 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b8b79dca-2b4d-48ee-818d-c0b18e5628c2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7555358 Jan 05 14:51:19.818520 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ab6d032f-85b6-459d-aedf-ac337806f73f', 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f', 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'fixed_ips': [{'subnet_id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 14:51:19.819893 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:20.115863 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Allocated IP 172.20.0.2 (ab6d032f-85b6-459d-aedf-ac337806f73f/fe44b4c9-34b5-45df-a4d5-fa041d1f4de8/727356d4-5716-4ba6-a00c-63c15fa6d059) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:51:20.353162 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:20.455792 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:20.535251 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Network ab6d032f-85b6-459d-aedf-ac337806f73f is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:51:20.543993 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:51:20.553349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:51:20.555324 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Pushing event updated for resources: {'Port': ['ID=727356d4-5716-4ba6-a00c-63c15fa6d059,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:20.565512 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.565877 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.566240 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.566579 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.566915 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.567244 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.567569 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.567891 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.568214 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.568550 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.568874 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.569219 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.569545 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Tracked resource versions report: Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: pushed versions: Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: { 'AddressGroup': {'1.2'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'ConntrackHelper': {'1.0'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Log': {'1.0'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Network': {'1.1'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Port': {'1.7'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'PortForwarding': {'1.2'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'QosPolicy': {'1.10'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroup': {'1.5'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'SubPort': {'1.0'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Subnet': {'1.1'}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Trunk': {'1.1'}} Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: consumer versions: Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'ConntrackHelper': '1.0', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'LocalIPAssociation': '1.0', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Log': '1.0', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Network': '1.1', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Port': '1.7', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'PortForwarding': '1.2', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'QosPolicy': '1.10', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroup': '1.5', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroupRule': '1.2', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'SubPort': '1.0', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Subnet': '1.1', Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: 'Trunk': '1.1'}} Jan 05 14:51:20.570937 dv-cinder-master-3-iscsi neutron-server[114656]: {{(pid=114656) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:51:20.645753 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Attempting to bind port 727356d4-5716-4ba6-a00c-63c15fa6d059 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:51:20.646151 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Attempting to bind port 727356d4-5716-4ba6-a00c-63c15fa6d059 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:51:20.646587 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Attempting to bind port 727356d4-5716-4ba6-a00c-63c15fa6d059 on network ab6d032f-85b6-459d-aedf-ac337806f73f {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:51:20.651471 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 51, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:51:20.651853 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Checking segment: {'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:51:20.652326 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:20.652712 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Bound using segment: {'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:51:20.653199 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Bound port: 727356d4-5716-4ba6-a00c-63c15fa6d059, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:51:20.653613 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:20.716607 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] For port 727356d4-5716-4ba6-a00c-63c15fa6d059, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:51:20.720764 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] For port 727356d4-5716-4ba6-a00c-63c15fa6d059, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=727356d4-5716-4ba6-a00c-63c15fa6d059,segment=NetworkSegment(75010be9-322b-4960-8f4f-2babd4962cf1),segment_id=75010be9-322b-4960-8f4f-2babd4962cf1)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:51:20.778641 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:20.848231 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0802acc2-f3c6-4ec5-838d-5aa312d7ccdf None None] Pushing event updated for resources: {'Port': ['ID=727356d4-5716-4ba6-a00c-63c15fa6d059,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:22.301010 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39802) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:22.620100 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [None req-1eb4c047-78c3-40c8-b538-dc5503aca808 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:51:22.621116 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-1eb4c047-78c3-40c8-b538-dc5503aca808 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3191221 Jan 05 14:51:25.279092 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39810) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:25.590864 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [None req-7384bb86-db0e-4503-bf86-f650e560016d admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:51:25.591871 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7384bb86-db0e-4503-bf86-f650e560016d admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3118372 Jan 05 14:51:25.970516 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:51:28.147068 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5ed131d6-bbaf-40f1-8dc7-897bd067bb97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:28.523354 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39820) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:28.834834 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-3fec7ee9-13ee-4248-9d8f-0cf5c2a22abe admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:51:28.923870 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3fec7ee9-13ee-4248-9d8f-0cf5c2a22abe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:28.925520 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3fec7ee9-13ee-4248-9d8f-0cf5c2a22abe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:29.068820 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3fec7ee9-13ee-4248-9d8f-0cf5c2a22abe admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:29.124389 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3fec7ee9-13ee-4248-9d8f-0cf5c2a22abe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:29.216936 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3fec7ee9-13ee-4248-9d8f-0cf5c2a22abe admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:29.218169 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-3fec7ee9-13ee-4248-9d8f-0cf5c2a22abe admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6938469 Jan 05 14:51:30.471849 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-92f90b3c-fcce-4e81-917a-08a810d2dde4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:30.904120 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 727356d4-5716-4ba6-a00c-63c15fa6d059 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:51:30.994722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 727356d4-5716-4ba6-a00c-63c15fa6d059 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:30.995046 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:31.106157 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:31.139407 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 727356d4-5716-4ba6-a00c-63c15fa6d059, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=727356d4-5716-4ba6-a00c-63c15fa6d059,segment=NetworkSegment(75010be9-322b-4960-8f4f-2babd4962cf1),segment_id=75010be9-322b-4960-8f4f-2babd4962cf1)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:51:31.217988 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:31.269046 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=727356d4-5716-4ba6-a00c-63c15fa6d059,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:31.735160 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:31.824126 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29917bd7-fc09-423d-a5fa-57c192f659ba None None] Network ab6d032f-85b6-459d-aedf-ac337806f73f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:51:31.904416 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-56cf9a2d-af47-425f-b810-96d4972bec64 None None] Provisioning complete for port 727356d4-5716-4ba6-a00c-63c15fa6d059 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:31.904784 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-56cf9a2d-af47-425f-b810-96d4972bec64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:31.913848 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 39842) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:32.152937 dv-cinder-master-3-iscsi neutron-server[114655]: WARNING oslo_policy.policy [None req-335f3aa9-8f31-49a0-a0da-5c02c6074be8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:32.153552 dv-cinder-master-3-iscsi neutron-server[114655]: WARNING oslo_policy.policy [None req-335f3aa9-8f31-49a0-a0da-5c02c6074be8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:32.248691 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-b29e343e-8f03-466a-b436-ec624a3a0e80 None None] Provisioning complete for port 727356d4-5716-4ba6-a00c-63c15fa6d059 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:32.248977 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b29e343e-8f03-466a-b436-ec624a3a0e80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:32.379816 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [None req-335f3aa9-8f31-49a0-a0da-5c02c6074be8 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114655) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:51:32.381105 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-335f3aa9-8f31-49a0-a0da-5c02c6074be8 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4652255 Jan 05 14:51:32.646078 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:32.873574 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 727356d4-5716-4ba6-a00c-63c15fa6d059 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:51:32.922296 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 727356d4-5716-4ba6-a00c-63c15fa6d059 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:32.922671 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:34.392637 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:34.927182 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39868) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:34.975363 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Request body: {'network': {'provider:network_type': 'flat', 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'router:external': True, 'is_default': True, 'name': 'public', 'tenant_id': 'df4f5a399f0847ef9e872ee655a1354c', 'admin_state_up': True, 'provider:physical_network': 'physnet1'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:51:35.051611 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Made reservation on behalf of df4f5a399f0847ef9e872ee655a1354c for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:51:35.053798 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.062248 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.137233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.217139 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.233813 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Reserving flat network on physical network physnet1 {{(pid=114654) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Jan 05 14:51:35.248765 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be86ff0b-6603-44ba-9c6a-ace0f68c3151,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:35.255490 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.255833 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Added segment eadfff16-a9dd-467f-8d2f-7ca3a3571fcf of type flat for network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 Jan 05 14:51:35.306530 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.406194 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.407126 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:35.407720 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:35.467011 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] Pushing event updated for resources: {'Network': ['ID=5a23f40f-adea-4ffc-bf9d-36fc05b21ca9,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:35.479557 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 14:51:35.503833 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-e76465da-ab98-42e0-bcd4-b931fbb1b05b admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5755668 Jan 05 14:51:37.980224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39876) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:38.068731 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7f8bea3-e3df-4df6-90ba-25c777e6679f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:38.070045 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b7f8bea3-e3df-4df6-90ba-25c777e6679f admin admin] 10.222.0.30 "GET /v2.0/subnets/fe44b4c9-34b5-45df-a4d5-fa041d1f4de8 HTTP/1.1" status: 200 len: 849 time: 0.0888586 Jan 05 14:51:38.183430 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-6adb5406-f374-4464-99ff-633cc47517e5 admin admin] 10.222.0.30 "GET /v2.0/routers/0af09a13-5937-4a89-8016-373b5efa1e7a HTTP/1.1" status: 200 len: 704 time: 0.1078994 Jan 05 14:51:38.443753 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:38.746188 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Allocated IP 172.20.0.1 (ab6d032f-85b6-459d-aedf-ac337806f73f/fe44b4c9-34b5-45df-a4d5-fa041d1f4de8/57593d0c-0a71-4d17-b0ce-5b0ef4cc902e) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:51:38.944880 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.069803 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.137622 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Network ab6d032f-85b6-459d-aedf-ac337806f73f is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:51:39.146316 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:51:39.153912 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:51:39.154446 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.213223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Pushing event updated for resources: {'Port': ['ID=57593d0c-0a71-4d17-b0ce-5b0ef4cc902e,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:39.377313 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-62f7f850-d93a-4b64-a64f-4e4dc130c21e None None] Provisioning complete for port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:39.377899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-62f7f850-d93a-4b64-a64f-4e4dc130c21e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.413123 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-62f7f850-d93a-4b64-a64f-4e4dc130c21e None None] Port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:51:39.419026 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.624160 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.688652 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.689405 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:39.766219 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Pushing event updated for resources: {'Port': ['ID=57593d0c-0a71-4d17-b0ce-5b0ef4cc902e,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:39.807152 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Network ab6d032f-85b6-459d-aedf-ac337806f73f is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:51:39.808438 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:51:40.017683 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Router 0af09a13-5937-4a89-8016-373b5efa1e7a is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114654) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 14:51:40.035413 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-354d9171-0567-4aef-b88e-746cc7e94142 None None] Provisioning complete for port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:40.035789 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-354d9171-0567-4aef-b88e-746cc7e94142 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:40.074343 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-354d9171-0567-4aef-b88e-746cc7e94142 None None] Port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:51:40.110909 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:51:40.118663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-3499718f-b67e-4eb6-91c4-78eec833eb67 admin admin] 10.222.0.30 "PUT /v2.0/routers/0af09a13-5937-4a89-8016-373b5efa1e7a/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9280262 Jan 05 14:51:40.119896 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Sync routers for ids ['0af09a13-5937-4a89-8016-373b5efa1e7a'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:51:40.134612 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Routers {'0af09a13-5937-4a89-8016-373b5efa1e7a'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:51:40.135573 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:51:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['0af09a13-5937-4a89-8016-373b5efa1e7a'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:40.323877 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Set router 0af09a13-5937-4a89-8016-373b5efa1e7a gateway port host: None {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:51:40.760748 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'name': 'router1', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:51:28Z', 'updated_at': '2022-01-05T14:51:39Z', 'revision_number': 2, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'gw_port_host': None, '_interfaces': [{'id': '57593d0c-0a71-4d17-b0ce-5b0ef4cc902e', 'name': '', 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'mac_address': 'fa:16:3e:44:fd:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:38Z', 'updated_at': '2022-01-05T14:51:39Z', 'revision_number': 2, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'subnets': [{'id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'dbf58974-bfe9-4253-a5b7-7953a1ccf866'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:40.811172 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Checking router: 0af09a13-5937-4a89-8016-373b5efa1e7a for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:51:40.811545 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Updating router 0af09a13-5937-4a89-8016-373b5efa1e7a port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:51:40.862069 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:41.368958 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:41.457359 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:41.618191 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Pushing event updated for resources: {'Port': ['ID=57593d0c-0a71-4d17-b0ce-5b0ef4cc902e,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:41.632575 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.632876 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.633263 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.633610 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.633950 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.634284 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.634615 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.634944 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.635273 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.635672 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.636010 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.636327 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.636653 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Tracked resource versions report: Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: pushed versions: Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: { 'AddressGroup': {'1.2'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'ConntrackHelper': {'1.0'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Log': {'1.0'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Network': {'1.1'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Port': {'1.7'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'PortForwarding': {'1.2'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'QosPolicy': {'1.10'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroup': {'1.5'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'SubPort': {'1.0'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Subnet': {'1.1'}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Trunk': {'1.1'}} Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: consumer versions: Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'ConntrackHelper': '1.0', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'LocalIPAssociation': '1.0', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Log': '1.0', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Network': '1.1', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Port': '1.7', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'PortForwarding': '1.2', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'QosPolicy': '1.10', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroup': '1.5', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroupRule': '1.2', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'SubPort': '1.0', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Subnet': '1.1', Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: 'Trunk': '1.1'}} Jan 05 14:51:41.638079 dv-cinder-master-3-iscsi neutron-server[114657]: {{(pid=114657) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:51:41.640937 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Attempting to bind port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:51:41.641359 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Attempting to bind port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:51:41.641814 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Attempting to bind port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e on network ab6d032f-85b6-459d-aedf-ac337806f73f {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:51:41.647952 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 51, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:51:41.648377 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Checking segment: {'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:51:41.648870 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:41.649294 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Bound using segment: {'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:51:41.649820 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Bound port: 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '75010be9-322b-4960-8f4f-2babd4962cf1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:51:41.650229 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:41.700758 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-48303ec8-157f-41d2-aec7-f0159813a098 None None] Provisioning complete for port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:41.701345 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-48303ec8-157f-41d2-aec7-f0159813a098 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:41.717927 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] For port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:51:41.735870 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-48303ec8-157f-41d2-aec7-f0159813a098 None None] Port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:51:41.737087 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] For port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=57593d0c-0a71-4d17-b0ce-5b0ef4cc902e,segment=NetworkSegment(75010be9-322b-4960-8f4f-2babd4962cf1),segment_id=75010be9-322b-4960-8f4f-2babd4962cf1)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:51:41.800411 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:41.846276 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Routers {'0af09a13-5937-4a89-8016-373b5efa1e7a'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:51:41.846869 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:51:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['0af09a13-5937-4a89-8016-373b5efa1e7a'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:41.928527 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8470957f-610b-423f-8235-52d2db15ebd5 None None] Pushing event updated for resources: {'Port': ['ID=57593d0c-0a71-4d17-b0ce-5b0ef4cc902e,revision_number=4']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:41.950500 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] Set router 0af09a13-5937-4a89-8016-373b5efa1e7a gateway port host: None {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:51:42.055247 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-6f6d47c4-be9c-42c4-a24e-d8e87c4bf3d2 None None] Provisioning complete for port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:42.055624 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6f6d47c4-be9c-42c4-a24e-d8e87c4bf3d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:42.139524 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6f6d47c4-be9c-42c4-a24e-d8e87c4bf3d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:42.161998 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'name': 'router1', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:51:28Z', 'updated_at': '2022-01-05T14:51:39Z', 'revision_number': 2, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'gw_port_host': None, '_interfaces': [{'id': '57593d0c-0a71-4d17-b0ce-5b0ef4cc902e', 'name': '', 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'mac_address': 'fa:16:3e:44:fd:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:38Z', 'updated_at': '2022-01-05T14:51:41Z', 'revision_number': 4, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'subnets': [{'id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'dbf58974-bfe9-4253-a5b7-7953a1ccf866'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:42.172286 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-6f6d47c4-be9c-42c4-a24e-d8e87c4bf3d2 None None] For port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=57593d0c-0a71-4d17-b0ce-5b0ef4cc902e,segment=NetworkSegment(75010be9-322b-4960-8f4f-2babd4962cf1),segment_id=75010be9-322b-4960-8f4f-2babd4962cf1)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:51:42.188631 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24730f91-1ffb-469c-bda9-d9161cce66fb None None] The sync data for ids ['0af09a13-5937-4a89-8016-373b5efa1e7a'] in dv-cinder-master-3-iscsi is: [{'id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'name': 'router1', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:51:28Z', 'updated_at': '2022-01-05T14:51:39Z', 'revision_number': 2, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'gw_port_host': None, '_interfaces': [{'id': '57593d0c-0a71-4d17-b0ce-5b0ef4cc902e', 'name': '', 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'mac_address': 'fa:16:3e:44:fd:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:38Z', 'updated_at': '2022-01-05T14:51:41Z', 'revision_number': 4, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'subnets': [{'id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'dbf58974-bfe9-4253-a5b7-7953a1ccf866'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:51:42.263375 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6f6d47c4-be9c-42c4-a24e-d8e87c4bf3d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:42.314021 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f6d47c4-be9c-42c4-a24e-d8e87c4bf3d2 None None] Pushing event updated for resources: {'Port': ['ID=57593d0c-0a71-4d17-b0ce-5b0ef4cc902e,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:45.181708 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39894) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:45.291176 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdd13e87-427f-4a5f-b9c3-cd41f4af0e40 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:45.296769 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-fdd13e87-427f-4a5f-b9c3-cd41f4af0e40 admin admin] 10.222.0.30 "GET /v2.0/networks/5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 HTTP/1.1" status: 200 len: 842 time: 0.1098139 Jan 05 14:51:45.302550 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'public-subnet', 'gateway_ip': '172.37.2.1', 'enable_dhcp': False, 'tenant_id': 'df4f5a399f0847ef9e872ee655a1354c', 'cidr': '172.37.2.0/24', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:51:45.391778 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Made reservation on behalf of df4f5a399f0847ef9e872ee655a1354c for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:51:45.394081 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Publish callbacks [] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:45.806228 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.objects.ports [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=114654) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Jan 05 14:51:45.806571 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:45.863476 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Pushing event updated for resources: {'Subnet': ['ID=bdce404c-f51c-4d0a-956e-f48c632a0324,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:45.871347 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:51:45.871701 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Network hostable DHCP agents. Network: 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 14:51:45.971266 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 14:51:46.039988 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:51:46.044299 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:46.045205 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:46.050914 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a190e874-8620-4c76-a8e2-1a2c9f76e064 None None] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:51:46.129438 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-417a7365-e70b-47fd-926f-0fc9316d391a admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8180008 Jan 05 14:51:46.154384 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c1de58d-27cd-4de7-b39e-73df8d4abee3 None None] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:51:48.679828 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 39906) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:48.823519 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-5e5a7325-1a42-4e1b-b486-951acf8eb83f admin admin] 10.222.0.30 "GET /v2.0/routers/0af09a13-5937-4a89-8016-373b5efa1e7a HTTP/1.1" status: 200 len: 710 time: 0.1379514 Jan 05 14:51:48.901686 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:51:48.911839 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6f4e214-9c2f-4e33-9796-74c7eb0b60f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:51:48.918165 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d6f4e214-9c2f-4e33-9796-74c7eb0b60f5 admin admin] 10.222.0.30 "GET /v2.0/networks/5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 HTTP/1.1" status: 200 len: 886 time: 0.0890322 Jan 05 14:51:48.922743 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:51:48.951381 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:48.951830 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:49.165869 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:49.455536 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:49.529835 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:49.635150 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Allocated IP 172.37.2.113 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:51:49.734016 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:49.840517 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:49.879447 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:51:49.886224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:51:49.888278 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Pushing event updated for resources: {'Port': ['ID=4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:49.892179 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:51:50.316148 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:50.509208 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-694619', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-713440', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-29970'] for router, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:50.512566 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-694608', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-694601', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-713433'] for router, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:50.614566 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Router 0af09a13-5937-4a89-8016-373b5efa1e7a has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 14:51:50.714244 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:51:50.719053 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:50.720226 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-bd687c11-ee7e-478a-9245-cae52db84666 admin admin] 10.222.0.30 "PUT /v2.0/routers/0af09a13-5937-4a89-8016-373b5efa1e7a HTTP/1.1" status: 200 len: 890 time: 1.8013604 Jan 05 14:51:50.740493 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Sync routers for ids ['0af09a13-5937-4a89-8016-373b5efa1e7a'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:51:50.752927 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Routers {'0af09a13-5937-4a89-8016-373b5efa1e7a'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:51:50.753699 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:51:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['0af09a13-5937-4a89-8016-373b5efa1e7a'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:50.973881 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Set router 0af09a13-5937-4a89-8016-373b5efa1e7a gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:51:51.433764 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'name': 'router1', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.113'}], 'enable_snat': True}, 'gw_port_id': '4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:51:28Z', 'updated_at': '2022-01-05T14:51:50Z', 'revision_number': 4, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'gw_port': {'id': '4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:fb:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:49Z', 'updated_at': '2022-01-05T14:51:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '57593d0c-0a71-4d17-b0ce-5b0ef4cc902e', 'name': '', 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'mac_address': 'fa:16:3e:44:fd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:38Z', 'updated_at': '2022-01-05T14:51:42Z', 'revision_number': 5, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'subnets': [{'id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'dbf58974-bfe9-4253-a5b7-7953a1ccf866'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:51.483642 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Checking router: 0af09a13-5937-4a89-8016-373b5efa1e7a for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:51:51.483992 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Updating router 0af09a13-5937-4a89-8016-373b5efa1e7a port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:51:51.530669 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:51.838910 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:51.905397 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:51.958135 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Attempting to bind port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:51:51.958507 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Attempting to bind port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:51:51.958870 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Attempting to bind port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:51:51.960970 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8bbb1dd-a1b8-43fd-ae86-7a2012d8b302 None None] Pushing event updated for resources: {'Port': ['ID=4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:51.966829 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 51, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:51:51.967202 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:51:51.968120 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:51.968120 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:51:51.968420 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Bound port: 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:51:51.968820 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:52.017513 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] For port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:51:52.023869 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] For port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:51:52.100628 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:52.160415 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8bbb1dd-a1b8-43fd-ae86-7a2012d8b302 None None] Pushing event updated for resources: {'Port': ['ID=4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:52.163541 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Routers {'0af09a13-5937-4a89-8016-373b5efa1e7a'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:51:52.164129 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:51:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['0af09a13-5937-4a89-8016-373b5efa1e7a'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:52.268585 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] Set router 0af09a13-5937-4a89-8016-373b5efa1e7a gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:51:52.487053 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'name': 'router1', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.113'}], 'enable_snat': True}, 'gw_port_id': '4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:51:28Z', 'updated_at': '2022-01-05T14:51:50Z', 'revision_number': 4, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'gw_port': {'id': '4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:fb:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:49Z', 'updated_at': '2022-01-05T14:51:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '57593d0c-0a71-4d17-b0ce-5b0ef4cc902e', 'name': '', 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'mac_address': 'fa:16:3e:44:fd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:38Z', 'updated_at': '2022-01-05T14:51:42Z', 'revision_number': 5, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'subnets': [{'id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'dbf58974-bfe9-4253-a5b7-7953a1ccf866'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:51:52.512775 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-033adf0e-5ea1-4676-82ec-08583a492403 None None] The sync data for ids ['0af09a13-5937-4a89-8016-373b5efa1e7a'] in dv-cinder-master-3-iscsi is: [{'id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'name': 'router1', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.113'}], 'enable_snat': True}, 'gw_port_id': '4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:51:28Z', 'updated_at': '2022-01-05T14:51:50Z', 'revision_number': 4, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'gw_port': {'id': '4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:fb:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:49Z', 'updated_at': '2022-01-05T14:51:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '57593d0c-0a71-4d17-b0ce-5b0ef4cc902e', 'name': '', 'network_id': 'ab6d032f-85b6-459d-aedf-ac337806f73f', 'tenant_id': '0c3d9801ad754740ae4b7891d05c103f', 'mac_address': 'fa:16:3e:44:fd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0af09a13-5937-4a89-8016-373b5efa1e7a', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:51:38Z', 'updated_at': '2022-01-05T14:51:42Z', 'revision_number': 5, 'project_id': '0c3d9801ad754740ae4b7891d05c103f', 'subnets': [{'id': 'fe44b4c9-34b5-45df-a4d5-fa041d1f4de8', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'dbf58974-bfe9-4253-a5b7-7953a1ccf866'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:51:52.912724 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:51:52.965704 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:52.966227 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:53.045722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:53.066820 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:51:53.148765 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:53.198973 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:51:53.379109 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 39916) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:51:53.603932 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.policy [None req-a3c9b46a-0f96-44fe-9737-02fc3d366c4c admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=114655) register_rules /opt/stack/neutron/neutron/policy.py:73}} Jan 05 14:51:53.649480 dv-cinder-master-3-iscsi neutron-server[114655]: WARNING oslo_policy.policy [None req-a3c9b46a-0f96-44fe-9737-02fc3d366c4c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:53.649845 dv-cinder-master-3-iscsi neutron-server[114655]: WARNING oslo_policy.policy [None req-a3c9b46a-0f96-44fe-9737-02fc3d366c4c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jan 05 14:51:53.659969 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a3c9b46a-0f96-44fe-9737-02fc3d366c4c admin admin] 10.222.0.30 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 413 time: 0.2798975 Jan 05 14:51:54.884231 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:51:54.938449 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4ba8877b-e9fe-4b57-a59d-d62f7dfdd4ae triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:51:54.938821 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:51:58.134866 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6e56fd99-02a1-488e-9338-53609bbc0634 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:00.434302 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-7c4c307a-dc19-49e1-8298-36bf8adec787 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:01.754298 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:02.645792 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:02.971712 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:52:04.399781 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:28.122222 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1db6ddf4-f442-4f6b-a9f2-e3516858c737 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:30.415811 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-71be7568-3960-4880-92d4-f4fbf7683c60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:31.730442 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:32.661229 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:35.015865 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:52:39.971378 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:52:58.117993 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-25b9e27d-d6b3-4797-b7d2-55f02c38834b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:00.380876 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-afacc411-f99b-4a7c-be3a-8042c4b52c5e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:01.743572 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:02.666688 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:04.383695 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:16.973080 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:53:17.499039 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40402) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:17.578443 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.pecan_wsgi.hooks.translation [None req-bdd41bdb-fdd2-4948-b63b-2665351fe993 admin admin] GET failed (client error): The resource could not be found. Jan 05 14:53:17.579714 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-bdd41bdb-fdd2-4948-b63b-2665351fe993 admin admin] 10.222.0.30 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0797594 Jan 05 14:53:17.773185 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b03681cb-a83e-45d3-85f5-1c966c703b37 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:17.774688 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-b03681cb-a83e-45d3-85f5-1c966c703b37 admin admin] 10.222.0.30 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1908741 Jan 05 14:53:20.167381 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40412) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:20.294656 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a178e5c4-1f27-43df-b449-eafa574e2689 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:20.299864 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a178e5c4-1f27-43df-b449-eafa574e2689 admin admin] 10.222.0.30 "GET /v2.0/subnets/fe44b4c9-34b5-45df-a4d5-fa041d1f4de8 HTTP/1.1" status: 200 len: 849 time: 0.1276772 Jan 05 14:53:20.305504 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:53:20.391933 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Publish callbacks [] for subnet, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:20.625382 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8783776005892'] for subnet, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:20.688573 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:20.689292 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:20.705094 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] 10.222.0.30 "PUT /v2.0/subnets/fe44b4c9-34b5-45df-a4d5-fa041d1f4de8 HTTP/1.1" status: 200 len: 868 time: 0.3889306 Jan 05 14:53:20.705323 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-069a7951-8555-4132-8240-a86ac7d8cbb1 None None] Network ab6d032f-85b6-459d-aedf-ac337806f73f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:53:20.705815 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe44b4c9-34b5-45df-a4d5-fa041d1f4de8,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:53:20.712391 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.712751 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.713113 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.713453 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.713829 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.714165 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.714538 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.714889 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.715255 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.715600 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.715978 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.716306 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.716625 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a12b2d5-2822-4305-8411-4e5ed76738bd admin admin] Tracked resource versions report: Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: pushed versions: Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: { 'AddressGroup': {'1.2'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'ConntrackHelper': {'1.0'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Log': {'1.0'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Network': {'1.1'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Port': {'1.7'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'PortForwarding': {'1.2'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'QosPolicy': {'1.10'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroup': {'1.5'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'SubPort': {'1.0'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Subnet': {'1.1'}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Trunk': {'1.1'}} Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: consumer versions: Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'ConntrackHelper': '1.0', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'LocalIPAssociation': '1.0', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Log': '1.0', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Network': '1.1', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Port': '1.7', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'PortForwarding': '1.2', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'QosPolicy': '1.10', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroup': '1.5', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroupRule': '1.2', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'SubPort': '1.0', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Subnet': '1.1', Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: 'Trunk': '1.1'}} Jan 05 14:53:20.718226 dv-cinder-master-3-iscsi neutron-server[114655]: {{(pid=114655) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:53:21.066791 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1985f289-8d65-4d4a-881c-1e6a8a9f7191 None None] Provisioning complete for port 727356d4-5716-4ba6-a00c-63c15fa6d059 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:53:21.067164 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1985f289-8d65-4d4a-881c-1e6a8a9f7191 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:21.157822 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1985f289-8d65-4d4a-881c-1e6a8a9f7191 None None] Provisioning complete for port 57593d0c-0a71-4d17-b0ce-5b0ef4cc902e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:53:21.158191 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1985f289-8d65-4d4a-881c-1e6a8a9f7191 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:23.120461 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40424) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:23.332711 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b337947d-e310-49aa-94c4-a572b1eeb9ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:23.333208 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b337947d-e310-49aa-94c4-a572b1eeb9ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:23.334748 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-b337947d-e310-49aa-94c4-a572b1eeb9ba admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2127643 Jan 05 14:53:25.761011 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40432) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:25.885540 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c49cd13-d3f6-4a34-8c2c-79b19fa44307 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:25.886007 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c49cd13-d3f6-4a34-8c2c-79b19fa44307 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:25.887530 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-6c49cd13-d3f6-4a34-8c2c-79b19fa44307 admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1256003 Jan 05 14:53:28.122467 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b65804f6-3af2-47e2-84df-2d2c2641ce74 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:28.327737 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40440) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:28.517424 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8711d823-ba9e-4fa5-a379-27f1409794c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:28.518789 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-8711d823-ba9e-4fa5-a379-27f1409794c3 admin admin] 10.222.0.30 "GET /v2.0/networks/5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 HTTP/1.1" status: 200 len: 886 time: 0.1901169 Jan 05 14:53:30.388493 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-50556ac7-5afb-415c-82ef-0dbd92cd145c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:30.942452 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40448) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:31.082023 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2377ee5f-82d0-4578-ad3f-bdea2942488c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:31.083416 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2377ee5f-82d0-4578-ad3f-bdea2942488c admin admin] 10.222.0.30 "GET /v2.0/networks/ab6d032f-85b6-459d-aedf-ac337806f73f HTTP/1.1" status: 200 len: 869 time: 0.1400154 Jan 05 14:53:31.756526 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:32.648089 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:33.508109 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40456) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:33.630241 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68458a7e-e107-4314-a3b3-5af9361aeed1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:33.630704 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68458a7e-e107-4314-a3b3-5af9361aeed1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:33.632227 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-68458a7e-e107-4314-a3b3-5af9361aeed1 admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1231740 Jan 05 14:53:34.376670 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:53:36.057200 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40464) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:36.169308 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50cac7c6-aa15-486f-b4d6-ee7d0f6b8464 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:36.169766 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50cac7c6-aa15-486f-b4d6-ee7d0f6b8464 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:36.171270 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-50cac7c6-aa15-486f-b4d6-ee7d0f6b8464 admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1131382 Jan 05 14:53:38.581311 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40472) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:38.668370 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-899beee0-fdfb-4090-b434-e505c73b26db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:38.669755 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-899beee0-fdfb-4090-b434-e505c73b26db admin admin] 10.222.0.30 "GET /v2.0/subnets/bdce404c-f51c-4d0a-956e-f48c632a0324 HTTP/1.1" status: 200 len: 816 time: 0.0874171 Jan 05 14:53:41.080450 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40482) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:53:41.172872 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15bef22d-875f-495b-b9dd-296d28cc0dbc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:53:41.174192 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-15bef22d-875f-495b-b9dd-296d28cc0dbc admin admin] 10.222.0.30 "GET /v2.0/subnets/fe44b4c9-34b5-45df-a4d5-fa041d1f4de8 HTTP/1.1" status: 200 len: 868 time: 0.0926869 Jan 05 14:53:53.971671 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:53:58.130381 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fb075e8d-03c7-44f3-b91c-7451d6dd9e0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:00.395896 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-cc442d56-294f-4741-8e0e-0e0fd24f074f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:01.741405 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:02.650523 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:04.389831 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:06.395588 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40536) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:54:06.453750 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [None req-aad9ff7d-a80c-48c6-b1dd-f903d4c17a03 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:54:06.454746 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-aad9ff7d-a80c-48c6-b1dd-f903d4c17a03 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0582151 Jan 05 14:54:08.952015 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40544) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:54:09.011762 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.pecan_wsgi.hooks.translation [None req-5473f830-fadf-4c0e-9053-da187974c304 admin admin] GET failed (client error): The resource could not be found. Jan 05 14:54:09.013037 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-5473f830-fadf-4c0e-9053-da187974c304 admin admin] 10.222.0.30 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0600681 Jan 05 14:54:09.154965 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3eebf5c7-a0c0-451d-b3cb-32663099489e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:54:09.156358 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-3eebf5c7-a0c0-451d-b3cb-32663099489e admin admin] 10.222.0.30 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1392646 Jan 05 14:54:11.633722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40554) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:54:11.677969 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Request body: {'network': {'tenant_id': 'df4f5a399f0847ef9e872ee655a1354c', 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:54:11.761600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Made reservation on behalf of df4f5a399f0847ef9e872ee655a1354c for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:54:11.764306 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:11.796881 dv-cinder-master-3-iscsi neutron-server[114654]: WARNING neutron.services.revisions.revision_plugin [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Could not find related network for resource to bump revision. Jan 05 14:54:11.807355 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 114} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 14:54:11.815642 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:11.815984 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Added segment 1b024b10-d466-4bbb-8a27-b254862142ea of type vlan for network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef Jan 05 14:54:11.853416 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:11.926995 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:11.927965 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:54:11.928560 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:11.984616 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Pushing event updated for resources: {'Network': ['ID=29d7c43c-ecaf-4875-bf66-b4812c9f9cef,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:54:11.991290 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.991641 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.991984 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.992319 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.992650 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.992978 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.993332 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.993661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.993988 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.994361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.994715 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.995038 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:11.995357 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:12.005560 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-20a2d0ae-91fa-4641-8145-e940474acdb5 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3692291 Jan 05 14:54:12.007338 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 14:54:14.527083 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40564) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:54:14.584796 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8da49ef-1c71-4765-b7d1-28abd1ed2cfa admin admin] GET failed (client error): The resource could not be found. Jan 05 14:54:14.586115 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-a8da49ef-1c71-4765-b7d1-28abd1ed2cfa admin admin] 10.222.0.30 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0580595 Jan 05 14:54:14.654561 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44bce37e-0040-42a6-9463-b1b6080ec836 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:54:14.655966 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-44bce37e-0040-42a6-9463-b1b6080ec836 admin admin] 10.222.0.30 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0651774 Jan 05 14:54:14.665507 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Request body: {'subnet': {'ip_version': 4, 'description': 'shared-subnet', 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'tenant_id': 'df4f5a399f0847ef9e872ee655a1354c'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:54:14.755459 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Made reservation on behalf of df4f5a399f0847ef9e872ee655a1354c for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:54:14.757699 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Publish callbacks [] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:14.981378 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:15.037812 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3c0e4e9-a75e-41b4-ad85-5081880d4366,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:54:15.043456 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Checking segment: {'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:54:15.043814 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Network hostable DHCP agents. Network: 29d7c43c-ecaf-4875-bf66-b4812c9f9cef, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 14:54:15.129485 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 14:54:15.192305 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 29d7c43c-ecaf-4875-bf66-b4812c9f9cef) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:54:15.196380 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:54:15.196961 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:15.201650 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46dc5b68-3484-4088-a602-195e544d04d1 None None] Network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:54:15.283855 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-fbe81b87-9e01-452a-a863-d38f87295318 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6215212 Jan 05 14:54:15.300190 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-29d7c43c-ecaf-4875-bf66-b4812c9f9cef', 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef', 'project_id': 'df4f5a399f0847ef9e872ee655a1354c', 'fixed_ips': [{'subnet_id': 'a3c0e4e9-a75e-41b4-ad85-5081880d4366'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 14:54:15.301238 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:15.443476 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Allocated IP 192.168.233.2 (29d7c43c-ecaf-4875-bf66-b4812c9f9cef/a3c0e4e9-a75e-41b4-ad85-5081880d4366/a355fd21-e0d5-4bf6-8618-cbd3999d98b0) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:54:15.684408 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:15.782065 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:15.828745 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:54:15.829848 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Pushing event updated for resources: {'Port': ['ID=a355fd21-e0d5-4bf6-8618-cbd3999d98b0,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:54:15.833241 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:54:15.837804 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:54:15.840979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.845979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:54:15.905442 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Attempting to bind port a355fd21-e0d5-4bf6-8618-cbd3999d98b0 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:54:15.905811 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Attempting to bind port a355fd21-e0d5-4bf6-8618-cbd3999d98b0 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:54:15.906174 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Attempting to bind port a355fd21-e0d5-4bf6-8618-cbd3999d98b0 on network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:54:15.911212 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 54, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:54:15.911586 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Checking segment: {'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:54:15.911985 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:15.912375 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Bound using segment: {'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:54:15.912836 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Bound port: a355fd21-e0d5-4bf6-8618-cbd3999d98b0, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:54:15.913259 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:15.974828 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] For port a355fd21-e0d5-4bf6-8618-cbd3999d98b0, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:54:15.977866 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] For port a355fd21-e0d5-4bf6-8618-cbd3999d98b0, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a355fd21-e0d5-4bf6-8618-cbd3999d98b0,segment=NetworkSegment(1b024b10-d466-4bbb-8a27-b254862142ea),segment_id=1b024b10-d466-4bbb-8a27-b254862142ea)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:54:16.062034 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:16.123148 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95314d53-65cc-4df7-85ab-82e56351b069 None None] Pushing event updated for resources: {'Port': ['ID=a355fd21-e0d5-4bf6-8618-cbd3999d98b0,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:54:16.990398 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device a355fd21-e0d5-4bf6-8618-cbd3999d98b0 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:54:17.052313 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port a355fd21-e0d5-4bf6-8618-cbd3999d98b0 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:54:17.052743 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:17.090305 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fd617f4-d4dc-4b71-a1ca-736660607116 None None] Network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:54:17.220174 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:17.239505 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-b7da12e0-9fb6-4e11-9894-5041b4c50658 None None] Provisioning complete for port a355fd21-e0d5-4bf6-8618-cbd3999d98b0 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:54:17.239863 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b7da12e0-9fb6-4e11-9894-5041b4c50658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:17.286713 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port a355fd21-e0d5-4bf6-8618-cbd3999d98b0, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a355fd21-e0d5-4bf6-8618-cbd3999d98b0,segment=NetworkSegment(1b024b10-d466-4bbb-8a27-b254862142ea),segment_id=1b024b10-d466-4bbb-8a27-b254862142ea)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:54:17.351002 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b7da12e0-9fb6-4e11-9894-5041b4c50658 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:17.360435 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:17.444098 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=a355fd21-e0d5-4bf6-8618-cbd3999d98b0,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:54:17.450823 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.db.api [None req-b7da12e0-9fb6-4e11-9894-5041b4c50658 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=114656) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jan 05 14:54:17.451205 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG oslo_db.api [None req-b7da12e0-9fb6-4e11-9894-5041b4c50658 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jan 05 14:54:18.113085 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-82e609b8-d787-466c-9c97-ca44a0929c17 None None] Provisioning complete for port a355fd21-e0d5-4bf6-8618-cbd3999d98b0 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:54:18.113713 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-82e609b8-d787-466c-9c97-ca44a0929c17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:18.953987 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device a355fd21-e0d5-4bf6-8618-cbd3999d98b0 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:54:19.001944 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port a355fd21-e0d5-4bf6-8618-cbd3999d98b0 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:54:19.002306 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:28.143178 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-8457da0a-094d-41ed-b31c-dd7ebd33ed36 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:30.365836 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3ca46e47-d7d7-41b8-aa89-15c3c1d0f591 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:30.969801 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:54:31.748967 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:32.640529 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:34.371904 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:54:58.128845 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-be3fe8a5-a644-49a2-807f-fcf2d5ca3c05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:00.362847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-cbbc7066-ba00-442c-aaa6-c00721a21bd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:01.774275 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:02.685331 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:04.382208 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:07.968909 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:55:28.133354 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-31734c44-ab7c-4708-8ab2-58869d56f138 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:30.373271 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a6be5a5f-8ffe-4c47-97be-84cbf2ea04d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:31.764384 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:32.710472 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:34.386877 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:44.968118 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:55:56.956002 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40610) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:55:56.962251 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [None req-1017b355-2ca4-4f66-bc08-1f90dda4594f tempest-verify_tempest_config-539660547 tempest-verify_tempest_config-539660547-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:55:56.963206 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-1017b355-2ca4-4f66-bc08-1f90dda4594f tempest-verify_tempest_config-539660547 tempest-verify_tempest_config-539660547-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0062351 Jan 05 14:55:57.485703 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40628) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:55:57.587063 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:57.655879 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:57.705985 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:57.750742 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=091c57af-b699-44da-9c54-76e7bb5bd1ae,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:55:57.755155 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0b62a90c843e4378a0fdf44ad995b78e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2684793 Jan 05 14:55:57.758102 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40632) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:55:57.759980 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.760327 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.760661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.760997 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.761351 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.761677 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.762016 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.762345 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.762667 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.763005 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.763328 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.763645 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.763957 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3560ccd6-9945-4427-9b9d-47b4bbc8a2fa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:57.837931 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:57.857977 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:58.014766 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:58.017477 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:55:58.018659 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/091c57af-b699-44da-9c54-76e7bb5bd1ae HTTP/1.1" status: 204 len: 168 time: 0.2594850 Jan 05 14:55:58.026333 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=091c57af-b699-44da-9c54-76e7bb5bd1ae,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:55:58.032837 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.033234 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.033584 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.033924 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.034256 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.034586 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.034931 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.035264 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.035720 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.035925 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.036258 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.036636 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.036956 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37faa9b3-d73d-48d8-bbdf-dec3c0060345 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:55:58.192222 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2fe0b525-e526-41e6-ab4d-c962a663ac05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:00.360928 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a1d9967a-ef57-426d-9b31-436552802093 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:01.769023 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:02.689018 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:04.391841 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:21.966453 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:56:28.144939 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e1553466-8a6b-4655-9904-5c505d5d7da1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:30.356440 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b7e10c12-846b-486d-b149-d94bda89d469 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:31.816849 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:32.684948 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:34.422056 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:58.133316 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-8f03a877-d113-4df0-90d3-b42ba9a3e31a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:56:58.965526 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 5 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:57:00.349989 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-48afca63-7809-48b9-8ab5-85a89d914d9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:01.809832 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:02.695837 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:04.387272 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:28.129209 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0757f3a0-b54b-454a-a0ae-229fe756ad39 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:30.389322 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2c69c2c2-0ed1-4bf3-b37a-e562eac81115 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:31.780772 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:32.483209 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-713545'] for agent, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:32.660294 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:34.422860 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:57:35.964494 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:57:48.702721 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40706) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:57:48.810018 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-0a7c7e69-f5c9-47cb-bfa6-4c7d9825015d admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1061430 Jan 05 14:57:51.234453 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40716) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:57:51.286983 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-0ce6d95b-53a1-4415-a232-7cf3a2beb94d admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0514753 Jan 05 14:57:58.134186 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aed443b5-79a0-4c6e-a093-5ce9aadb9cf5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:00.364895 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-68ded734-6898-459c-bca0-bd9445deb50b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:01.793267 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:02.430513 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:02.682484 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:04.396757 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:12.962827 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:58:28.161441 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6fc50bb3-be5d-47c0-adf0-5bb5e95974c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:30.401214 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-82b8c93f-043e-427b-a36d-e2f523e43b38 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:31.784391 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:32.421261 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:32.663926 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:34.392887 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:58:49.962457 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:58:58.140177 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-af9ce236-9325-48ad-a486-bf2197c6c96a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:00.423771 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-11eff9be-45cd-4704-ad29-f22538eea0ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:01.811909 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:02.423231 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:02.668748 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:04.397162 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:21.660399 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40902) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:22.000069 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-network', 'tenant_id': '9c7d005c6e9e454fa506907144639917'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:22.001773 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.quota [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Loaded quota_driver: . Jan 05 14:59:22.177613 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Made reservation on behalf of 9c7d005c6e9e454fa506907144639917 for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:22.182318 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.193664 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.275210 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.344641 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40934) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:22.351992 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.386417 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 101} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 14:59:22.404916 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2aae8d23-92a7-4bb0-acdc-7a19b112309f,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:22.408706 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8783776153137', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.409301 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Unsubscribe: segment precommit_create {{(pid=114655) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Jan 05 14:59:22.409777 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Added segment 837624e7-6703-4540-ba8b-9f16e4400b5c of type vlan for network 975fa447-11a2-47cd-86bf-82619c2a8abd Jan 05 14:59:22.424707 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.425056 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.425457 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.425759 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.426085 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.426415 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.426743 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.427065 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.427406 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.427731 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.428049 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.428368 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.428684 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Tracked resource versions report: Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: pushed versions: Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: { 'AddressGroup': {'1.2'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'ConntrackHelper': {'1.0'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Log': {'1.0'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Network': {'1.1'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Port': {'1.7'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'PortForwarding': {'1.2'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'QosPolicy': {'1.10'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroup': {'1.5'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'SubPort': {'1.0'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Subnet': {'1.1'}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Trunk': {'1.1'}} Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: consumer versions: Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: HyperV agent@hv-cinder-maste: {}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'ConntrackHelper': '1.0', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'LocalIPAssociation': '1.0', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Log': '1.0', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Network': '1.1', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Port': '1.7', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'PortForwarding': '1.2', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'QosPolicy': '1.10', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroup': '1.5', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'SecurityGroupRule': '1.2', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'SubPort': '1.0', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Subnet': '1.1', Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: 'Trunk': '1.1'}} Jan 05 14:59:22.429933 dv-cinder-master-3-iscsi neutron-server[114655]: {{(pid=114655) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:59:22.480784 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.537225 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40950) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:22.594811 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.596056 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:22.596650 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.695835 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] Pushing event updated for resources: {'Network': ['ID=975fa447-11a2-47cd-86bf-82619c2a8abd,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:22.707378 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 975fa447-11a2-47cd-86bf-82619c2a8abd details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 14:59:22.728366 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-59e6d9ba-cbd8-4f91-b6d6-9b51ae59b544 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.0669100 Jan 05 14:59:22.731454 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40956) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:22.736266 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Request body: {'subnet': {'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-subnet', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:22.741431 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-879065659-network', 'tenant_id': 'fc623d81b10e491ab3a65d62b99bf7c7'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:22.797394 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40958) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:22.853109 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-network', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:22.862480 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Made reservation on behalf of fc623d81b10e491ab3a65d62b99bf7c7 for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:22.862480 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.874952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-337172709-network', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:22.884216 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Made reservation on behalf of 9c7d005c6e9e454fa506907144639917 for: {'subnet': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:22.891857 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.892259 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:22.983186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.060417 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.089965 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:23.101345 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.102029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.103189 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.103769 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.104331 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.108144 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.112749 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.113409 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.116951 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.118235 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.119922 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.120496 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.121009 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Tracked resource versions report: Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: pushed versions: Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: { 'AddressGroup': {'1.2'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'ConntrackHelper': {'1.0'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Log': {'1.0'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Network': {'1.1'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Port': {'1.7'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'PortForwarding': {'1.2'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'QosPolicy': {'1.10'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroup': {'1.5'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'SubPort': {'1.0'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Subnet': {'1.1'}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Trunk': {'1.1'}} Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: consumer versions: Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: HyperV agent@hv-cinder-maste: {}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'ConntrackHelper': '1.0', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'LocalIPAssociation': '1.0', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Log': '1.0', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Network': '1.1', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Port': '1.7', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'PortForwarding': '1.2', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'QosPolicy': '1.10', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroup': '1.5', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'SecurityGroupRule': '1.2', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'SubPort': '1.0', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Subnet': '1.1', Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: 'Trunk': '1.1'}} Jan 05 14:59:23.122218 dv-cinder-master-3-iscsi neutron-server[114654]: {{(pid=114654) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:59:23.129353 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Made reservation on behalf of 715006ffd8ba4e5b963511ec759ae152 for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:23.143027 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.154186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 102} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 14:59:23.157262 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.159109 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Made reservation on behalf of f4a45a70c5d046238abaad07fbe529e9 for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:23.161301 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.174976 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.183927 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.188483 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.188826 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Added segment 9090f950-f416-4528-99a8-79f83e6339eb of type vlan for network fca65618-396e-44a0-8e47-55fa90240fd2 Jan 05 14:59:23.238062 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=05f78cb6-38bd-4a95-a1d0-4c4654bbd075,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:23.290615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Checking segment: {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:23.291239 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Network hostable DHCP agents. Network: 975fa447-11a2-47cd-86bf-82619c2a8abd, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114655) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 14:59:23.383291 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.397643 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Network 975fa447-11a2-47cd-86bf-82619c2a8abd is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114655) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 14:59:23.486094 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 975fa447-11a2-47cd-86bf-82619c2a8abd) {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:23.500234 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:23.500520 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2ea53aa-d8bd-49d6-b858-7fcaac0c3e9d None None] Network 975fa447-11a2-47cd-86bf-82619c2a8abd requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:23.501080 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.502262 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.518938 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.542590 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.544133 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:23.545758 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.570518 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.599287 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45322ef2-639b-4bd2-822a-909e20e6ad4c None None] Network 975fa447-11a2-47cd-86bf-82619c2a8abd requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:23.618732 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 146} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 14:59:23.622524 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1ddd4f17-3735-49b7-9216-1cced8dd5df2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.8900130 Jan 05 14:59:23.627597 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 40992) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:23.627902 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:23.632133 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.635895 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] Pushing event updated for resources: {'Network': ['ID=fca65618-396e-44a0-8e47-55fa90240fd2,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:23.652016 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network fca65618-396e-44a0-8e47-55fa90240fd2 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 14:59:23.654753 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.654753 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Added segment 07f0d075-8e78-40da-9903-e50c29fe982c of type vlan for network fb7bcda7-5039-4d82-bf68-12c9acc8a744 Jan 05 14:59:23.663553 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=847274a0-8363-42b6-acf6-390991642d01,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:23.670359 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 145} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 14:59:23.705790 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b9074167-dcf1-454d-a36e-9ccdc463c7a7 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.3599083 Jan 05 14:59:23.713507 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 40994) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:23.723049 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Request body: {'subnet': {'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-879065659-subnet', 'tenant_id': 'fc623d81b10e491ab3a65d62b99bf7c7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:23.729327 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.729924 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Added segment 6c95c843-d01b-4253-a6ef-82805037a6f7 of type vlan for network 1c375b41-1339-4d14-93e7-e473aa7e6978 Jan 05 14:59:23.784549 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9eb21158-42db-4023-a3d1-404639319159,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:23.790586 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.802653 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.804270 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.808070 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.987142 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.992198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:23.993220 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:23.993822 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.048326 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Made reservation on behalf of fc623d81b10e491ab3a65d62b99bf7c7 for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:24.050657 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Publish callbacks [] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.052283 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.053181 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:24.053764 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.077983 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] Pushing event updated for resources: {'Network': ['ID=fb7bcda7-5039-4d82-bf68-12c9acc8a744,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:24.088163 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 14:59:24.133966 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-55ae6860-f36b-4660-8ef3-876d04df0ade admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.3354113 Jan 05 14:59:24.137570 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41004) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:24.143245 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Request body: {'subnet': {'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-337172709-subnet', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:24.195428 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] Pushing event updated for resources: {'Network': ['ID=1c375b41-1339-4d14-93e7-e473aa7e6978,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:24.207092 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 14:59:24.232256 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-232fe610-c869-4656-aeff-d301ce684594 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.6910017 Jan 05 14:59:24.235367 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41008) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:24.245821 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Request body: {'subnet': {'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-subnet', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:24.314803 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.412685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Made reservation on behalf of f4a45a70c5d046238abaad07fbe529e9 for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:24.412685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Publish callbacks [] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.480592 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.486670 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Made reservation on behalf of 715006ffd8ba4e5b963511ec759ae152 for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:24.488933 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Publish callbacks [] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.642531 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Pushing event updated for resources: {'Subnet': ['ID=851aa76f-ccc4-4997-b93f-8238639e6bfa,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:24.686023 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Checking segment: {'id': '9090f950-f416-4528-99a8-79f83e6339eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:24.686023 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Network hostable DHCP agents. Network: fca65618-396e-44a0-8e47-55fa90240fd2, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 14:59:24.712488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.739252 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.829707 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Network fca65618-396e-44a0-8e47-55fa90240fd2 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 14:59:24.883400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.923755 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Allocated IP 172.37.2.168 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/5a6617dc-dbb7-455d-bd98-a3b0247f9180) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:24.935632 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.937516 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, fca65618-396e-44a0-8e47-55fa90240fd2) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:24.948469 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1636ce4d-22bb-484f-9a79-9364a54b2930 None None] Network fca65618-396e-44a0-8e47-55fa90240fd2 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:24.950609 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:24.951381 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:24.965413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=afd427f5-19eb-439b-9825-d3ec4a285d49,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:25.043119 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Checking segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:25.043611 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Network hostable DHCP agents. Network: 1c375b41-1339-4d14-93e7-e473aa7e6978, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 14:59:25.045620 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fd51f09d-6379-4a7e-97a4-fafd6cf55180,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:25.051641 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Checking segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:25.052171 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Network hostable DHCP agents. Network: fb7bcda7-5039-4d82-bf68-12c9acc8a744, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 14:59:25.065927 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.078901 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82bfae1b-c180-48ec-a670-20458bfaf837 None None] Network fca65618-396e-44a0-8e47-55fa90240fd2 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:25.118787 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-4b0f1f0e-f773-4a0a-8d37-a29354d09366 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.3989031 Jan 05 14:59:25.231386 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 14:59:25.232145 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41052) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:25.265925 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.266385 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 14:59:25.339423 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 1c375b41-1339-4d14-93e7-e473aa7e6978) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:25.354338 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Pushing event updated for resources: {'Port': ['ID=5a6617dc-dbb7-455d-bd98-a3b0247f9180,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:25.362454 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8614f5bd-9ee5-4857-9aad-fceaeded851f None None] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:25.369244 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:25.373895 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:25.375508 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:25.379665 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:25.383392 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.388219 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2ffec3c3-fc87-4454-9ec3-84f0795dca3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.394741 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, fb7bcda7-5039-4d82-bf68-12c9acc8a744) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:25.403574 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:25.408852 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.432699 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d4bc2cd-e548-4ae1-bd1f-c695e57ca3b4 None None] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:25.523426 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-5b31611f-71d9-4fa7-896e-3712f0754e25 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.3848484 Jan 05 14:59:25.526451 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41074) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:25.532418 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:25.571405 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41076) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:25.582240 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-88dd3223-2cd7-46a3-89e7-1359807502b8 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.3457348 Jan 05 14:59:25.593213 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:25.623251 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 14:59:25.625080 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.654930 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2ffec3c3-fc87-4454-9ec3-84f0795dca3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.686246 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1c375b41-1339-4d14-93e7-e473aa7e6978', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 14:59:25.691383 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.753545 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41104) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:25.755785 dv-cinder-master-3-iscsi neutron-server[114655]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jan 05 14:59:25.762964 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.764431 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.775715 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2ffec3c3-fc87-4454-9ec3-84f0795dca3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.827868 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:25.903177 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2ffec3c3-fc87-4454-9ec3-84f0795dca3a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=06f71d61e6814a3b828958a1728183ae&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6698856 Jan 05 14:59:25.907331 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41110) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:25.942671 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Allocated IP 172.20.0.2 (fb7bcda7-5039-4d82-bf68-12c9acc8a744/fd51f09d-6379-4a7e-97a4-fafd6cf55180/ace48ad1-7011-475a-9bbb-f8af2f228cfd) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:25.949324 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Allocated IP 172.20.0.2 (1c375b41-1339-4d14-93e7-e473aa7e6978/afd427f5-19eb-439b-9825-d3ec4a285d49/6bf4317f-dc27-4f96-8b94-f8059ce91f4a) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:26.093669 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ffec3c3-fc87-4454-9ec3-84f0795dca3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd6cb302-e578-4d17-b122-5ce02ac9def1,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:26.110204 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.114534 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a626dbb0-01f3-4020-85ef-432b5022d73e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.142574 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.143628 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.153767 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a626dbb0-01f3-4020-85ef-432b5022d73e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.269426 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-254c558c-1142-4085-8bb4-0f7fdb0f3e54 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:26.271192 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-254c558c-1142-4085-8bb4-0f7fdb0f3e54 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/networks?id=fca65618-396e-44a0-8e47-55fa90240fd2 HTTP/1.1" status: 200 len: 811 time: 0.5165570 Jan 05 14:59:26.280508 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.302390 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.337769 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-03bfb840-ecf6-41e7-8104-2ebbf9542561 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/quotas/fc623d81b10e491ab3a65d62b99bf7c7 HTTP/1.1" status: 200 len: 375 time: 0.0604188 Jan 05 14:59:26.370573 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.375473 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.428086 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-dca3ec6e-7ff4-484b-9ece-bbc9c65386cd tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=fc623d81b10e491ab3a65d62b99bf7c7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0609722 Jan 05 14:59:26.450585 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a626dbb0-01f3-4020-85ef-432b5022d73e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.453408 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a626dbb0-01f3-4020-85ef-432b5022d73e admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.454567 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-a626dbb0-01f3-4020-85ef-432b5022d73e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/bd6cb302-e578-4d17-b122-5ce02ac9def1 HTTP/1.1" status: 204 len: 168 time: 0.5473282 Jan 05 14:59:26.461831 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.480972 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:26.482415 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Pushing event updated for resources: {'Port': ['ID=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:26.485674 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:26.488905 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:26.507785 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.509376 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.509831 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.510182 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.512610 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.512965 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.513361 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.513699 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.514030 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.514625 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.514754 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.515035 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.515363 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Tracked resource versions report: Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: pushed versions: Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: { 'AddressGroup': {'1.2'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'ConntrackHelper': {'1.0'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Log': {'1.0'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Network': {'1.1'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Port': {'1.7'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'PortForwarding': {'1.2'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'QosPolicy': {'1.10'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroup': {'1.5'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'SubPort': {'1.0'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Subnet': {'1.1'}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Trunk': {'1.1'}} Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: consumer versions: Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: HyperV agent@hv-cinder-maste: {}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'ConntrackHelper': '1.0', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'LocalIPAssociation': '1.0', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Log': '1.0', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Network': '1.1', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Port': '1.7', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'PortForwarding': '1.2', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'QosPolicy': '1.10', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroup': '1.5', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'SecurityGroupRule': '1.2', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'SubPort': '1.0', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Subnet': '1.1', Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: 'Trunk': '1.1'}} Jan 05 14:59:26.516942 dv-cinder-master-3-iscsi neutron-server[114656]: {{(pid=114656) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:59:26.544751 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a626dbb0-01f3-4020-85ef-432b5022d73e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd6cb302-e578-4d17-b122-5ce02ac9def1,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:26.553049 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.617786 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.628746 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Pushing event updated for resources: {'Port': ['ID=ace48ad1-7011-475a-9bbb-f8af2f228cfd,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:26.645956 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-8d3ef3ee-8c55-4c92-addc-67d9dd8aa420 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114655) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:59:26.646995 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-8d3ef3ee-8c55-4c92-addc-67d9dd8aa420 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1153605 Jan 05 14:59:26.662402 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Attempting to bind port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:26.672708 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Attempting to bind port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:26.672708 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Attempting to bind port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a on network 1c375b41-1339-4d14-93e7-e473aa7e6978 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:26.678487 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:26.685328 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:26.688374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:26.693688 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:26.694160 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Checking segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:26.694762 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.695217 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Bound using segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:26.695767 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Bound port: 6bf4317f-dc27-4f96-8b94-f8059ce91f4a, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:26.696226 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.724623 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.783094 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.838806 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Attempting to bind port ace48ad1-7011-475a-9bbb-f8af2f228cfd on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:26.839694 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Attempting to bind port ace48ad1-7011-475a-9bbb-f8af2f228cfd by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:26.840160 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Attempting to bind port ace48ad1-7011-475a-9bbb-f8af2f228cfd on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:26.854407 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:26.855089 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Checking segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:26.855752 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.856168 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Bound using segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:26.856697 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Bound port: ace48ad1-7011-475a-9bbb-f8af2f228cfd, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:26.857116 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.873223 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-21809608-430c-40ce-8840-d5876abe96a5 service neutron] 10.222.0.30 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2190673 Jan 05 14:59:26.875657 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:26.880431 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] For port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:26.910402 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Allocated IP 172.37.2.131 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:26.919392 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] For port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:26.969646 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 14:59:26.983147 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] For port ace48ad1-7011-475a-9bbb-f8af2f228cfd, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:26.989542 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] For port ace48ad1-7011-475a-9bbb-f8af2f228cfd, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ace48ad1-7011-475a-9bbb-f8af2f228cfd,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:27.041429 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:27.083791 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:27.135636 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-6366a79d-ff07-4fd6-8c9f-43ba0343570b service neutron] 10.222.0.30 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2519195 Jan 05 14:59:27.148378 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:27.242638 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a730ac-c1b2-4608-b1b3-4f27165bdfd3 None None] Pushing event updated for resources: {'Port': ['ID=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:27.248915 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:27.390562 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:27.396872 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:27.406532 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Router f934a04d-bde3-4b0d-b89f-2a4d778671c2 is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114655) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 14:59:27.422934 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:27.426250 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:27.428332 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-113a2eec-b166-40a8-bf0a-76014c64778d None None] Pushing event updated for resources: {'Port': ['ID=ace48ad1-7011-475a-9bbb-f8af2f228cfd,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:27.459639 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Pushing event updated for resources: {'Port': ['ID=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:27.497409 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:27.790499 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41182) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:27.793224 dv-cinder-master-3-iscsi neutron-server[114654]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jan 05 14:59:27.869911 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9324daa5-fc13-4894-9863-41159db8090f req-b58caadb-418a-4fbb-a50a-cae77d51afe3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.0777888 Jan 05 14:59:28.002672 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:59:28.021517 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Sync routers for ids ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:59:28.036023 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Routers {'f934a04d-bde3-4b0d-b89f-2a4d778671c2'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:28.036667 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:28.042681 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Allocated IP 172.37.2.58 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/620ad2a4-14a0-4247-bbce-da5c4a989c40) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:28.059415 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.126353 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.130971 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-b1a5ed65-3c4f-4c2d-b010-4042da94c454 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 4.5068400 Jan 05 14:59:28.135635 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41196) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:28.165894 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e1e2064b-7c8b-49ef-8862-f97bc16f11a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.373326 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.378172 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41204) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:28.384667 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Set router f934a04d-bde3-4b0d-b89f-2a4d778671c2 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:28.415991 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.770887 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.865887 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Router d3c49f70-ad09-435c-bdeb-024562318429 is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114654) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 14:59:28.873607 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2aa4ef9f-d20c-47c6-b873-ceb10dd4dcae admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.909142 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Pushing event updated for resources: {'Port': ['ID=620ad2a4-14a0-4247-bbce-da5c4a989c40,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:28.911390 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T14:59:25Z', 'revision_number': 3, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:28.935657 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:28.953552 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Checking router: f934a04d-bde3-4b0d-b89f-2a4d778671c2 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:59:28.954422 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Updating router f934a04d-bde3-4b0d-b89f-2a4d778671c2 port 5a6617dc-dbb7-455d-bd98-a3b0247f9180 binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:59:28.981194 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:28.987227 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:28.987440 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:29.017608 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ccb214a2-ec88-4dd3-9b72-5d22bbc716d1 req-c8fbccf4-1b63-4461-9b5e-86e4cba5bc80 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.0633805 Jan 05 14:59:29.099401 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:59:29.114475 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Sync routers for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:59:29.128555 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:29.129387 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:29.239535 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.241045 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c4201a3f-d88b-4cb4-901c-30fa6654896d admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 3.7133448 Jan 05 14:59:29.243842 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41234) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:29.281615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b18dbfe8-ea72-481f-9542-e23a2ce95418 None None] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:29.413496 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.497022 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.500566 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2aa4ef9f-d20c-47c6-b873-ceb10dd4dcae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.525269 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.557032 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Pushing event updated for resources: {'Port': ['ID=5a6617dc-dbb7-455d-bd98-a3b0247f9180,revision_number=2']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:29.575053 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6bf4317f-dc27-4f96-8b94-f8059ce91f4a up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:29.581623 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.595056 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2aa4ef9f-d20c-47c6-b873-ceb10dd4dcae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.595205 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.595656 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.596668 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.597305 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a429de51-6747-4588-bfcb-35fa7eebd88b None None] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 14:59:29.597825 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.599137 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.599756 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.600433 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.600993 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.601606 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.602159 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.602933 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.603526 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Tracked resource versions report: Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: pushed versions: Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: { 'AddressGroup': {'1.2'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'ConntrackHelper': {'1.0'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'LocalIPAssociation': {'1.0'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Log': {'1.0'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Network': {'1.1'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Port': {'1.7'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'PortForwarding': {'1.2'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'QosPolicy': {'1.10'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroup': {'1.5'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroupRule': {'1.2'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'SubPort': {'1.0'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Subnet': {'1.1'}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Trunk': {'1.1'}} Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: consumer versions: Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: { DHCP agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: HyperV agent@hv-cinder-maste: {}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: L3 agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: Metadata agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: Metering agent@dv-cinder-master-3-iscsi: {}, Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: Open vSwitch agent@dv-cinder-master-3-iscsi: { 'AddressGroup': '1.2', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'ConntrackHelper': '1.0', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'LocalIPAssociation': '1.0', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Log': '1.0', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Network': '1.1', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Port': '1.7', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'PortForwarding': '1.2', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'QosPolicy': '1.10', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroup': '1.5', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'SecurityGroupRule': '1.2', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'SubPort': '1.0', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Subnet': '1.1', Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: 'Trunk': '1.1'}} Jan 05 14:59:29.606630 dv-cinder-master-3-iscsi neutron-server[114657]: {{(pid=114657) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jan 05 14:59:29.667983 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Attempting to bind port 5a6617dc-dbb7-455d-bd98-a3b0247f9180 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:29.668365 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Attempting to bind port 5a6617dc-dbb7-455d-bd98-a3b0247f9180 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:29.668863 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Attempting to bind port 5a6617dc-dbb7-455d-bd98-a3b0247f9180 on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:29.678605 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:29.679968 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:29.680493 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.682130 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:29.691426 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Bound port: 5a6617dc-dbb7-455d-bd98-a3b0247f9180, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:29.694087 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.774130 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] For port 5a6617dc-dbb7-455d-bd98-a3b0247f9180, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:29.778061 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] For port 5a6617dc-dbb7-455d-bd98-a3b0247f9180, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5a6617dc-dbb7-455d-bd98-a3b0247f9180,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:29.793768 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-700dfc76-d1ac-40b7-9b16-6fc1abd7606e None None] Provisioning complete for port ace48ad1-7011-475a-9bbb-f8af2f228cfd triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:29.794318 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-700dfc76-d1ac-40b7-9b16-6fc1abd7606e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.836833 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.841028 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.952512 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2aa4ef9f-d20c-47c6-b873-ceb10dd4dcae admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e08383aa131642f0a2cb2ee9db59eac9&name=default HTTP/1.1" status: 200 len: 2992 time: 1.5729403 Jan 05 14:59:29.953945 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41262) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:29.970022 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa4ef9f-d20c-47c6-b873-ceb10dd4dcae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1926995-32e4-4a6d-bb77-03f3e82782b2,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:29.986717 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:29.990553 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f8005c-517b-4619-b562-0768f349d2bc None None] Pushing event updated for resources: {'Port': ['ID=5a6617dc-dbb7-455d-bd98-a3b0247f9180,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:30.009425 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Routers {'f934a04d-bde3-4b0d-b89f-2a4d778671c2'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:30.013409 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:30.177828 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] Set router f934a04d-bde3-4b0d-b89f-2a4d778671c2 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:30.358707 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02f72ebe-04f3-44af-b465-2419dd1a296a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:30.483659 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Allocated IP 172.20.0.1 (975fa447-11a2-47cd-86bf-82619c2a8abd/05f78cb6-38bd-4a95-a1d0-4c4654bbd075/381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:30.497985 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02f72ebe-04f3-44af-b465-2419dd1a296a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:30.522006 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:30.561573 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-164be83a-ff9f-4ae3-b13e-09ce527bf0ca req-d8d374b7-272d-43b9-b4d8-63fdd639dc87 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.3905230 Jan 05 14:59:30.565706 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T14:59:25Z', 'revision_number': 3, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:30.591561 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Allocated IP 172.20.0.1 (fb7bcda7-5039-4d82-bf68-12c9acc8a744/fd51f09d-6379-4a7e-97a4-fafd6cf55180/109db72b-debc-46ae-9b63-f8edec570b8e) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:30.605602 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6894ef72-c94f-4de4-9f2f-a43f73385072 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:30.633513 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b11bfe3-e87e-44a4-846a-3dea1b23cb5d None None] The sync data for ids ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'] in dv-cinder-master-3-iscsi is: [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T14:59:25Z', 'revision_number': 3, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:59:30.663478 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:30.730455 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:30.730810 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.155208 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.166623 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.167245 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-700dfc76-d1ac-40b7-9b16-6fc1abd7606e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.167394 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.167757 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.194814 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Network 975fa447-11a2-47cd-86bf-82619c2a8abd is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:31.200308 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:31.207912 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:31.208745 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.222784 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:31.267678 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:31.299186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:31.299824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.311318 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-700dfc76-d1ac-40b7-9b16-6fc1abd7606e None None] For port ace48ad1-7011-475a-9bbb-f8af2f228cfd, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ace48ad1-7011-475a-9bbb-f8af2f228cfd,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:31.315984 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.325699 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Pushing event updated for resources: {'Port': ['ID=109db72b-debc-46ae-9b63-f8edec570b8e,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:31.353854 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Pushing event updated for resources: {'Port': ['ID=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:31.441284 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:31.461908 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:27Z', 'revision_number': 3, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:31.526974 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-700dfc76-d1ac-40b7-9b16-6fc1abd7606e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.534531 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Checking router: d3c49f70-ad09-435c-bdeb-024562318429 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:59:31.534885 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Updating router d3c49f70-ad09-435c-bdeb-024562318429 port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:59:31.571448 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02f72ebe-04f3-44af-b465-2419dd1a296a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.578912 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.579691 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ace48ad1-7011-475a-9bbb-f8af2f228cfd up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:31.585309 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02f72ebe-04f3-44af-b465-2419dd1a296a admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.600584 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-02f72ebe-04f3-44af-b465-2419dd1a296a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f1926995-32e4-4a6d-bb77-03f3e82782b2 HTTP/1.1" status: 204 len: 168 time: 1.6243329 Jan 05 14:59:31.651871 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f72ebe-04f3-44af-b465-2419dd1a296a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1926995-32e4-4a6d-bb77-03f3e82782b2,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:31.721707 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.726652 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.814743 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-e5305f7d-3a78-49bc-b929-0e0fc9755951 None None] Provisioning complete for port 109db72b-debc-46ae-9b63-f8edec570b8e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:31.815629 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e5305f7d-3a78-49bc-b929-0e0fc9755951 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:31.817537 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-700dfc76-d1ac-40b7-9b16-6fc1abd7606e None None] Pushing event updated for resources: {'Port': ['ID=ace48ad1-7011-475a-9bbb-f8af2f228cfd,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:31.823147 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Router 9ec87e52-56d6-4808-9eb4-61d2fe146230 is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114655) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 14:59:31.990572 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.009726 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.045383 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-e5305f7d-3a78-49bc-b929-0e0fc9755951 None None] Port 109db72b-debc-46ae-9b63-f8edec570b8e cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:59:32.073975 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41334) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:32.092869 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port ace48ad1-7011-475a-9bbb-f8af2f228cfd triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:32.093797 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.215257 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:32.236818 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-e5305f7d-3a78-49bc-b929-0e0fc9755951 None None] Provisioning complete for port ace48ad1-7011-475a-9bbb-f8af2f228cfd triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:32.237225 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e5305f7d-3a78-49bc-b929-0e0fc9755951 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.308080 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-41136a37-1617-4860-9f8e-91b3602eef62 req-eb08320f-c30e-44b2-be82-63a3492dd750 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.2317665 Jan 05 14:59:32.342684 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.351687 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.354302 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:59:32.372603 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Sync routers for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:59:32.387497 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:32.388259 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:32.429649 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.430383 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.463979 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.471400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41356) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:32.471716 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-aaf4d776-01e7-4264-89fa-ebec1153c821 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 6.8888195 Jan 05 14:59:32.472834 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.481893 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.504163 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.511360 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:32.649574 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.777267 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Pushing event updated for resources: {'Port': ['ID=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:32.782298 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:29Z', 'revision_number': 3, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:32.782655 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2b9997d6-aaf7-40ea-9a56-df038fd06823 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.792755 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Network 975fa447-11a2-47cd-86bf-82619c2a8abd is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:32.794793 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:32.802844 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc4a6a8-c69d-4ea4-81f8-c50011a639b1 None None] Pushing event updated for resources: {'Port': ['ID=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:32.823348 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.840470 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Pushing event updated for resources: {'Port': ['ID=109db72b-debc-46ae-9b63-f8edec570b8e,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:32.842088 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Checking router: 9ec87e52-56d6-4808-9eb4-61d2fe146230 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:59:32.842703 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Updating router 9ec87e52-56d6-4808-9eb4-61d2fe146230 port 620ad2a4-14a0-4247-bbce-da5c4a989c40 binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:59:32.904684 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:32.998282 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6bf4317f-dc27-4f96-8b94-f8059ce91f4a up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:33.015511 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Attempting to bind port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:33.015929 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Attempting to bind port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:33.016296 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Attempting to bind port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:33.062975 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.13', 56419) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:33.130445 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.131048 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Router f934a04d-bde3-4b0d-b89f-2a4d778671c2 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 14:59:33.155326 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:33.156709 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:33.157997 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.167138 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:33.169083 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Bound port: 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:33.169715 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.246528 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:33.302119 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:33.369588 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-e5305f7d-3a78-49bc-b929-0e0fc9755951 None None] Provisioning complete for port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:33.370525 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e5305f7d-3a78-49bc-b929-0e0fc9755951 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.387149 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:59:33.425127 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-33f009e8-1863-499d-ab24-da19807a4d06 admin admin] 10.222.0.30 "PUT /v2.0/routers/f934a04d-bde3-4b0d-b89f-2a4d778671c2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2783608 Jan 05 14:59:33.454909 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] For port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:33.460851 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:33.461252 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.698960 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] For port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:33.803592 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.806968 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.862553 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2b9997d6-aaf7-40ea-9a56-df038fd06823 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.869826 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-083eb5fb-4781-47d9-b414-860580cb438f req-fce3a937-a18d-4582-9eb6-39e32e8ecfde tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.0948765 Jan 05 14:59:33.878631 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 5a6617dc-dbb7-455d-bd98-a3b0247f9180 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:33.881689 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Sync routers for ids ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:59:33.918517 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7effc33f-f266-40de-8940-931c0e6c9a07 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:33.920849 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7effc33f-f266-40de-8940-931c0e6c9a07 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.13 "GET /v2.0/networks?id=fca65618-396e-44a0-8e47-55fa90240fd2 HTTP/1.1" status: 200 len: 811 time: 0.8567531 Jan 05 14:59:33.942682 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:33.958850 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:33.959549 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:33.973826 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Routers {'f934a04d-bde3-4b0d-b89f-2a4d778671c2'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:33.974473 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:33.977976 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc4a6a8-c69d-4ea4-81f8-c50011a639b1 None None] Pushing event updated for resources: {'Port': ['ID=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:34.081764 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Attempting to bind port 620ad2a4-14a0-4247-bbce-da5c4a989c40 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:34.082186 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Attempting to bind port 620ad2a4-14a0-4247-bbce-da5c4a989c40 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:34.082572 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Attempting to bind port 620ad2a4-14a0-4247-bbce-da5c4a989c40 on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:34.091917 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:34.091917 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:34.091917 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.091917 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:34.091917 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Bound port: 620ad2a4-14a0-4247-bbce-da5c4a989c40, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:34.092433 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.139149 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-5b3ae2d0-f2dc-4513-9fa5-12bb8ba2a952 None None] Provisioning complete for port 109db72b-debc-46ae-9b63-f8edec570b8e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:34.139522 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5b3ae2d0-f2dc-4513-9fa5-12bb8ba2a952 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.160671 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877264a5-4187-4aae-a533-3bac1bc8d9f7 None None] Pushing event updated for resources: {'Port': ['ID=620ad2a4-14a0-4247-bbce-da5c4a989c40,revision_number=2']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:34.228640 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Request body: {'port': {'device_id': '6cf86612-a721-4032-9b56-b9828fc658cd', 'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2', 'admin_state_up': True, 'tenant_id': 'fc623d81b10e491ab3a65d62b99bf7c7'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:34.230671 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] For port 620ad2a4-14a0-4247-bbce-da5c4a989c40, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:34.237715 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2b9997d6-aaf7-40ea-9a56-df038fd06823 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.240885 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] For port 620ad2a4-14a0-4247-bbce-da5c4a989c40, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=620ad2a4-14a0-4247-bbce-da5c4a989c40,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:34.312587 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.365755 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-5b3ae2d0-f2dc-4513-9fa5-12bb8ba2a952 None None] Port 109db72b-debc-46ae-9b63-f8edec570b8e cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:59:34.393035 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 5a6617dc-dbb7-455d-bd98-a3b0247f9180 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:34.393742 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.397801 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Router d3c49f70-ad09-435c-bdeb-024562318429 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 14:59:34.487734 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877264a5-4187-4aae-a533-3bac1bc8d9f7 None None] Pushing event updated for resources: {'Port': ['ID=620ad2a4-14a0-4247-bbce-da5c4a989c40,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:34.498961 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:34.501909 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:34.531377 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Set router f934a04d-bde3-4b0d-b89f-2a4d778671c2 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:34.567901 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2b9997d6-aaf7-40ea-9a56-df038fd06823 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b895d9e0ea654bc0bf2f35a27f097b7e&name=default HTTP/1.1" status: 200 len: 2992 time: 2.4884434 Jan 05 14:59:34.570540 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41442) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:34.593739 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.628914 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b9997d6-aaf7-40ea-9a56-df038fd06823 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b0043be-45a5-4a61-ac54-f8afd9fcab86,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:34.640484 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:34.677110 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a59751e7-9a3d-4128-a287-d623a3f45f3f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.716563 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:34.747227 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a59751e7-9a3d-4128-a287-d623a3f45f3f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.938630 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a59751e7-9a3d-4128-a287-d623a3f45f3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.943014 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a59751e7-9a3d-4128-a287-d623a3f45f3f admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:34.943290 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a59751e7-9a3d-4128-a287-d623a3f45f3f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8b0043be-45a5-4a61-ac54-f8afd9fcab86 HTTP/1.1" status: 204 len: 168 time: 0.3710146 Jan 05 14:59:34.951983 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59751e7-9a3d-4128-a287-d623a3f45f3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b0043be-45a5-4a61-ac54-f8afd9fcab86,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:34.984477 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:59:35.004305 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-a3bd97fd-f108-497b-ad19-f2fd2d3add47 admin admin] 10.222.0.30 "PUT /v2.0/routers/d3c49f70-ad09-435c-bdeb-024562318429/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7526813 Jan 05 14:59:35.014951 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-63db1645-030f-4836-99f6-cdb85e071d76 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:35.016513 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-63db1645-030f-4836-99f6-cdb85e071d76 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 819 time: 0.2912600 Jan 05 14:59:35.019759 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:35.092371 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:35.093800 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-663cd0da-c169-43b5-9b28-bdcb0c133db2 req-1c8c4609-bb6b-4ce9-98a7-b78b383f49f4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.0390525 Jan 05 14:59:35.093872 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-4047da7c-3be7-42a3-8349-23f8d8d68f11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/quotas/9c7d005c6e9e454fa506907144639917 HTTP/1.1" status: 200 len: 375 time: 0.0512519 Jan 05 14:59:35.106137 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 5a6617dc-dbb7-455d-bd98-a3b0247f9180, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5a6617dc-dbb7-455d-bd98-a3b0247f9180,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:35.116812 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:29Z', 'revision_number': 3, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:35.127259 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f', 'name': '', 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'mac_address': 'fa:16:3e:08:f6:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:29Z', 'updated_at': '2022-01-05T14:59:32Z', 'revision_number': 2, 'project_id': '9c7d005c6e9e454fa506907144639917', 'subnets': [{'id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:35.129183 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41476) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:35.159084 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Made reservation on behalf of fc623d81b10e491ab3a65d62b99bf7c7 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:35.162857 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:35.171174 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ccc3fe-c174-44be-bc6d-c03499b86406 None None] The sync data for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi is: [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:29Z', 'revision_number': 3, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:59:35.172526 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Checking router: f934a04d-bde3-4b0d-b89f-2a4d778671c2 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:59:35.172891 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Updating router f934a04d-bde3-4b0d-b89f-2a4d778671c2 port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:59:35.214128 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:35.222491 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:35.237998 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ace48ad1-7011-475a-9bbb-f8af2f228cfd up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:35.289256 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-f86072ca-be1c-4079-aa1e-0da147a63a20 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2104905 Jan 05 14:59:35.373367 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=5a6617dc-dbb7-455d-bd98-a3b0247f9180,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:35.548338 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port ace48ad1-7011-475a-9bbb-f8af2f228cfd triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:35.548805 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:35.580387 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 2, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:35.594841 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Allocated IP 172.20.0.4 (fca65618-396e-44a0-8e47-55fa90240fd2/851aa76f-ccc4-4997-b93f-8238639e6bfa/a1de646c-827f-41ad-bab9-8457e33db96d) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:35.625536 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Allocated IP 172.20.0.1 (1c375b41-1339-4d14-93e7-e473aa7e6978/afd427f5-19eb-439b-9825-d3ec4a285d49/179bc084-ed48-4658-9f6b-af880ff5322a) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:35.731259 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd4250b1-c1df-4159-a655-41f38336b194 None None] The sync data for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi is: [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 2, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:59:36.070536 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5703d673-f6ff-4237-b713-a908e7f8edbd admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.313593 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.325074 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5703d673-f6ff-4237-b713-a908e7f8edbd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.456892 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5703d673-f6ff-4237-b713-a908e7f8edbd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.561530 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.583678 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.631616 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.712791 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.839603 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Pushing event updated for resources: {'Port': ['ID=179bc084-ed48-4658-9f6b-af880ff5322a,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:36.896787 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:36.905317 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:36.913970 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:36.914889 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:36.954297 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5703d673-f6ff-4237-b713-a908e7f8edbd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47f5c14c-f4f2-4e94-946e-5f81aa21a1c9,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:36.963322 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5703d673-f6ff-4237-b713-a908e7f8edbd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6ace62f50516457cafc0b284bac70247&name=default HTTP/1.1" status: 200 len: 2992 time: 1.8328538 Jan 05 14:59:36.969797 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41520) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:37.019186 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41522) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:37.048095 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d2485b5-35b3-4793-9957-b4b5a868d97a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.104431 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.111732 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 5a6617dc-dbb7-455d-bd98-a3b0247f9180 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:37.190006 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd072460-2b07-4ba6-9ea3-88ff8539156f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.283493 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Network fca65618-396e-44a0-8e47-55fa90240fd2 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:37.316223 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd072460-2b07-4ba6-9ea3-88ff8539156f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.330065 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:37.337688 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:37.352230 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:37.356110 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.359670 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e44c98-3b67-4045-93c1-255bd754c1dc None None] Pushing event updated for resources: {'Port': ['ID=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:37.431315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-37b08bae-c2b9-4335-98d1-c24c376890b3 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:59:37.432309 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-37b08bae-c2b9-4335-98d1-c24c376890b3 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.8360662 Jan 05 14:59:37.464045 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Pushing event updated for resources: {'Port': ['ID=a1de646c-827f-41ad-bab9-8457e33db96d,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:37.476563 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d2485b5-35b3-4793-9957-b4b5a868d97a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.485847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Attempting to bind port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:37.488206 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Attempting to bind port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:37.488858 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Attempting to bind port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f on network 975fa447-11a2-47cd-86bf-82619c2a8abd {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:37.527233 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-e4807922-a59a-47e1-a24b-68c240685b5d None None] Provisioning complete for port 179bc084-ed48-4658-9f6b-af880ff5322a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:37.527609 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e4807922-a59a-47e1-a24b-68c240685b5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.544954 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d2485b5-35b3-4793-9957-b4b5a868d97a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.602602 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41530) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:37.602696 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:37.602696 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Checking segment: {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:37.603270 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd072460-2b07-4ba6-9ea3-88ff8539156f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.604884 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd072460-2b07-4ba6-9ea3-88ff8539156f admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.606129 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-fd072460-2b07-4ba6-9ea3-88ff8539156f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/47f5c14c-f4f2-4e94-946e-5f81aa21a1c9 HTTP/1.1" status: 204 len: 168 time: 0.6367860 Jan 05 14:59:37.608407 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9d2485b5-35b3-4793-9957-b4b5a868d97a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=94e0c100c2dd40cf958e4b1ca8ee33be&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5880332 Jan 05 14:59:37.609141 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.609706 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Bound using segment: {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:37.610374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Bound port: 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:37.610992 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.617201 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41534) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:37.622988 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c39479ef-313d-4b42-ab9f-c7e0b11ebcc4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4720912 Jan 05 14:59:37.655352 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 5a6617dc-dbb7-455d-bd98-a3b0247f9180 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:37.656682 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.709511 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-1b4dda42-dd73-428a-b440-4ea70ee4c69a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 14:59:37.710570 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-1b4dda42-dd73-428a-b440-4ea70ee4c69a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0100455 Jan 05 14:59:37.712653 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d2485b5-35b3-4793-9957-b4b5a868d97a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e64481c3-3816-47a5-b1d7-4f4521b6bed5,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:37.740309 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-e4807922-a59a-47e1-a24b-68c240685b5d None None] Port 179bc084-ed48-4658-9f6b-af880ff5322a cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:59:37.798711 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd072460-2b07-4ba6-9ea3-88ff8539156f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47f5c14c-f4f2-4e94-946e-5f81aa21a1c9,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:37.816001 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4c62a8aa-473d-4f79-87c8-e5166ccd1b74 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.888840 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] For port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:37.953301 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] For port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:37.971375 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4c62a8aa-473d-4f79-87c8-e5166ccd1b74 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:37.971878 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41538) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:37.977963 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-e45965bc-c33d-4eb9-83a9-c019626354f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1690308885', 'description': 'tempest-description--1723562048'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:37.991307 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 620ad2a4-14a0-4247-bbce-da5c4a989c40 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:38.112109 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.243204 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 620ad2a4-14a0-4247-bbce-da5c4a989c40 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:38.243204 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.243561 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-f5b1888b-29f1-4801-b122-8e9143a8bc8b service neutron] 10.222.0.30 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7231750 Jan 05 14:59:38.244384 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 req-02bcdfef-cd49-4cf5-8986-879ae81412bb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:38.244384 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 req-02bcdfef-cd49-4cf5-8986-879ae81412bb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 931 time: 0.1335778 Jan 05 14:59:38.244953 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Routers {'f934a04d-bde3-4b0d-b89f-2a4d778671c2'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:38.244953 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:38.315954 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d1db01e7-b679-4a02-bb04-d5d4128b3e36 req-00d876c0-33ba-46da-a336-6e19a637a444 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1058116 Jan 05 14:59:38.337827 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e44c98-3b67-4045-93c1-255bd754c1dc None None] Pushing event updated for resources: {'Port': ['ID=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:38.364100 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e2e9098-65c2-4674-af2d-95100aa844c8 service neutron] 10.222.0.30 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1685438 Jan 05 14:59:38.388550 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4c62a8aa-473d-4f79-87c8-e5166ccd1b74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.392092 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4c62a8aa-473d-4f79-87c8-e5166ccd1b74 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.394058 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4c62a8aa-473d-4f79-87c8-e5166ccd1b74 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e64481c3-3816-47a5-b1d7-4f4521b6bed5 HTTP/1.1" status: 204 len: 168 time: 0.7640841 Jan 05 14:59:38.416353 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c62a8aa-473d-4f79-87c8-e5166ccd1b74 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e64481c3-3816-47a5-b1d7-4f4521b6bed5,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:38.440051 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e45965bc-c33d-4eb9-83a9-c019626354f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.489704 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] Set router f934a04d-bde3-4b0d-b89f-2a4d778671c2 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:38.493458 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.560988 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.643287 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 620ad2a4-14a0-4247-bbce-da5c4a989c40, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=620ad2a4-14a0-4247-bbce-da5c4a989c40,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:38.762309 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e45965bc-c33d-4eb9-83a9-c019626354f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.771308 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:38.829962 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e45965bc-c33d-4eb9-83a9-c019626354f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.018180 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b1b4294e-0e16-4862-925c-6b5fa9929c23 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.018374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=620ad2a4-14a0-4247-bbce-da5c4a989c40,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:39.073416 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b1e00218-f17c-4d87-94b3-051b68006abd req-e592f80f-b9b4-431f-b248-eb1a8e667fb9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 210 time: 0.1700120 Jan 05 14:59:39.082546 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45965bc-c33d-4eb9-83a9-c019626354f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'SecurityGroup': ['ID=552b70d6-a366-4dff-9b66-b1679ffedd08,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:39.097915 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e45965bc-c33d-4eb9-83a9-c019626354f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.099673 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-e45965bc-c33d-4eb9-83a9-c019626354f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.1267712 Jan 05 14:59:39.107808 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41562) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:39.114385 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-163a7a82-30e9-40a4-984d-a09e57df53f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'security_group_rule': {'security_group_id': '552b70d6-a366-4dff-9b66-b1679ffedd08', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:39.133422 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:39.160924 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41566) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:39.245510 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-163a7a82-30e9-40a4-984d-a09e57df53f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.251641 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f', 'name': '', 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'mac_address': 'fa:16:3e:08:f6:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:29Z', 'updated_at': '2022-01-05T14:59:37Z', 'revision_number': 4, 'project_id': '9c7d005c6e9e454fa506907144639917', 'subnets': [{'id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:39.253684 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:39.261236 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.274970 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b1b4294e-0e16-4862-925c-6b5fa9929c23 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.305460 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Request body: {'port': {'device_id': '6cf86612-a721-4032-9b56-b9828fc658cd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:39.388401 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-163a7a82-30e9-40a4-984d-a09e57df53f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.407907 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06247ee9-ae0b-4899-8c54-1afd4e2894fe None None] The sync data for ids ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'] in dv-cinder-master-3-iscsi is: [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f', 'name': '', 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'mac_address': 'fa:16:3e:08:f6:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:29Z', 'updated_at': '2022-01-05T14:59:37Z', 'revision_number': 4, 'project_id': '9c7d005c6e9e454fa506907144639917', 'subnets': [{'id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:59:39.482593 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-163a7a82-30e9-40a4-984d-a09e57df53f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.550023 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163a7a82-30e9-40a4-984d-a09e57df53f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=38ead1ee-fd34-4199-8e81-d74ceced69bd,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:39.573581 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b1b4294e-0e16-4862-925c-6b5fa9929c23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.575809 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.584483 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.637393 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:39.674088 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-163a7a82-30e9-40a4-984d-a09e57df53f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.677417 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-163a7a82-30e9-40a4-984d-a09e57df53f6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5685332 Jan 05 14:59:39.682453 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41584) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:39.684504 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-04bfb017-80c3-4956-9ffe-15919031937a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'security_group_rule': {'security_group_id': '552b70d6-a366-4dff-9b66-b1679ffedd08', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:39.703185 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.732280 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b4294e-0e16-4862-925c-6b5fa9929c23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=720044e5-eb69-4f72-bdfb-7574f15cf834,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:39.737596 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.826964 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04bfb017-80c3-4956-9ffe-15919031937a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.834413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.834413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:39.874980 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:40.030342 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b1b4294e-0e16-4862-925c-6b5fa9929c23 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7c9351ecdd7d430d8c3ae7895011f66d&name=default HTTP/1.1" status: 200 len: 2996 time: 2.4290402 Jan 05 14:59:40.121452 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-71bff437-61db-4936-91df-22161d28adf8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:40.123547 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41602) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:40.167095 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04bfb017-80c3-4956-9ffe-15919031937a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:40.207157 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Pushing event updated for resources: {'Port': ['ID=179bc084-ed48-4658-9f6b-af880ff5322a,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:40.259078 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-814cc5b4-d840-46d8-a96d-bb50d808d638 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:40.275070 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-814cc5b4-d840-46d8-a96d-bb50d808d638 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 819 time: 0.3679535 Jan 05 14:59:40.295651 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04bfb017-80c3-4956-9ffe-15919031937a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:40.343965 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-80b9b168-e81c-4282-804c-e7b4d81f2848 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/quotas/9c7d005c6e9e454fa506907144639917 HTTP/1.1" status: 200 len: 375 time: 0.0661759 Jan 05 14:59:40.381326 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:40.392233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 req-1f107f75-87ae-4ba2-b898-8bc6e386ea83 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:40.398008 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bfb017-80c3-4956-9ffe-15919031937a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c08f8cb-ff36-41de-ab58-bf95c541fd82,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:40.399115 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 req-1f107f75-87ae-4ba2-b898-8bc6e386ea83 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 931 time: 0.8499312 Jan 05 14:59:40.485861 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-390b0e0c-a689-4217-9621-b9ec08b30ff2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1405821 Jan 05 14:59:40.500285 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04bfb017-80c3-4956-9ffe-15919031937a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:40.504639 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-04bfb017-80c3-4956-9ffe-15919031937a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8237619 Jan 05 14:59:40.509823 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41614) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:40.535639 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:40.780303 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-0a27b9d5-77fd-4ef6-8d91-6295d11ed49f service neutron] 10.222.0.30 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1438658 Jan 05 14:59:40.782493 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:40.865152 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-f0700bcb-ebcc-43c2-86d6-72e4d76366f1 service neutron] 10.222.0.30 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1795945 Jan 05 14:59:40.899514 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.037848 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Sync routers for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:59:41.060027 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:41.060676 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:41.228914 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:41.305894 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-52fcec6c-f674-490b-9145-5bfff835e284 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.332696 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1de646c-827f-41ad-bab9-8457e33db96d {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 14:59:41.453336 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-277ad37d-dae2-4fe1-849d-f370149a847e None None] Provisioning complete for port 179bc084-ed48-4658-9f6b-af880ff5322a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:41.454944 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-277ad37d-dae2-4fe1-849d-f370149a847e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.524337 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:41.527863 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d53f9a04-16db-4b0d-abdb-cac4f8bd7a9b req-286a264d-887a-490c-8d94-18256de9875b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.2608175 Jan 05 14:59:41.568006 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-277ad37d-dae2-4fe1-849d-f370149a847e None None] Port 179bc084-ed48-4658-9f6b-af880ff5322a cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:59:41.574466 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:41.574466 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.625723 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-71bff437-61db-4936-91df-22161d28adf8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.639979 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.668627 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.716266 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-52fcec6c-f674-490b-9145-5bfff835e284 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.925640 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:41.926474 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f2ad8c15-d3cf-4fec-9f5c-c84a076bee18 req-a7ed5726-d399-47e0-8d99-97cd67059545 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.4346378 Jan 05 14:59:41.926474 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Transition to ACTIVE for port object a1de646c-827f-41ad-bab9-8457e33db96d will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 14:59:41.926926 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Allocated IP 172.37.2.32 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/398afa2a-6e6d-493b-b78c-fc2dedf65aab) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:41.950794 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:41.958537 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-71bff437-61db-4936-91df-22161d28adf8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.022872 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-71bff437-61db-4936-91df-22161d28adf8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ea9610acf168459db6721420c43a17b4&name=default HTTP/1.1" status: 200 len: 2996 time: 2.8585591 Jan 05 14:59:42.024042 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41652) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:42.043942 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Router 9ec87e52-56d6-4808-9eb4-61d2fe146230 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 14:59:42.045661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71bff437-61db-4936-91df-22161d28adf8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64cba8f2-ecd4-48b5-beb4-19332243160e,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:42.150350 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 2, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:42.162906 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.163682 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:42.225725 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.262454 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Checking router: d3c49f70-ad09-435c-bdeb-024562318429 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:59:42.262784 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Updating router d3c49f70-ad09-435c-bdeb-024562318429 port 109db72b-debc-46ae-9b63-f8edec570b8e binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:59:42.362128 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.364315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-52fcec6c-f674-490b-9145-5bfff835e284 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.369267 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-52fcec6c-f674-490b-9145-5bfff835e284 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.371001 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-52fcec6c-f674-490b-9145-5bfff835e284 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/720044e5-eb69-4f72-bdfb-7574f15cf834 HTTP/1.1" status: 204 len: 168 time: 2.1604590 Jan 05 14:59:42.374987 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.450760 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:42.497170 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52fcec6c-f674-490b-9145-5bfff835e284 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=720044e5-eb69-4f72-bdfb-7574f15cf834,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:42.505547 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:42.506305 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.580052 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.696130 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 14:59:42.713329 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-1e06325b-92e5-4d36-a129-4042ebe06644 admin admin] 10.222.0.30 "PUT /v2.0/routers/9ec87e52-56d6-4808-9eb4-61d2fe146230/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.2248154 Jan 05 14:59:42.815589 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:42.844312 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Sync routers for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 14:59:42.844844 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'Port': ['ID=398afa2a-6e6d-493b-b78c-fc2dedf65aab,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:42.844920 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:42.845007 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:42.861837 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Pushing event updated for resources: {'Port': ['ID=a1de646c-827f-41ad-bab9-8457e33db96d,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:42.877858 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:42.891465 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:42.892097 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:42.932638 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 620ad2a4-14a0-4247-bbce-da5c4a989c40 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:42.958494 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bcef9095-47ef-4f28-9b50-94abd2b1f898 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.093592 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ad9fca1c-b07a-4099-8c7b-49b8e7ec213a req-893cd95b-3b45-4f1f-ae05-190178ba2e15 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.2179961 Jan 05 14:59:43.093714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Attempting to bind port a1de646c-827f-41ad-bab9-8457e33db96d on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:43.093714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Attempting to bind port a1de646c-827f-41ad-bab9-8457e33db96d by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '9090f950-f416-4528-99a8-79f83e6339eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:43.093714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Attempting to bind port a1de646c-827f-41ad-bab9-8457e33db96d on network fca65618-396e-44a0-8e47-55fa90240fd2 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:43.093714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bcef9095-47ef-4f28-9b50-94abd2b1f898 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.108278 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.112891 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 req-6f425e87-da7d-439f-b8ae-dc4039c24a92 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:43.114493 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 req-6f425e87-da7d-439f-b8ae-dc4039c24a92 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.1012900 Jan 05 14:59:43.115100 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Port a1de646c-827f-41ad-bab9-8457e33db96d on network fca65618-396e-44a0-8e47-55fa90240fd2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 14:59:43.115927 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Attempting to bind port a1de646c-827f-41ad-bab9-8457e33db96d on network fca65618-396e-44a0-8e47-55fa90240fd2 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:43.150520 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:43.150978 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Checking segment: {'id': '9090f950-f416-4528-99a8-79f83e6339eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:43.151480 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Bound using segment: {'id': '9090f950-f416-4528-99a8-79f83e6339eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:43.152119 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Bound port: a1de646c-827f-41ad-bab9-8457e33db96d, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9090f950-f416-4528-99a8-79f83e6339eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:43.152592 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.228420 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b353fa7-7ede-4c53-84df-3f24bfbb45c8 req-cb8a7cbf-49a9-4b20-b344-e21e7f8c6666 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1055608 Jan 05 14:59:43.247133 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.309147 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:43.329794 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 620ad2a4-14a0-4247-bbce-da5c4a989c40 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:43.329794 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.332300 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.386024 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] For port a1de646c-827f-41ad-bab9-8457e33db96d, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:43.393938 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] For port a1de646c-827f-41ad-bab9-8457e33db96d, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a1de646c-827f-41ad-bab9-8457e33db96d,segment=NetworkSegment(9090f950-f416-4528-99a8-79f83e6339eb),segment_id=9090f950-f416-4528-99a8-79f83e6339eb)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:43.461949 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Attempting to bind port 109db72b-debc-46ae-9b63-f8edec570b8e on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:43.463899 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Attempting to bind port 109db72b-debc-46ae-9b63-f8edec570b8e by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:43.463899 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Attempting to bind port 109db72b-debc-46ae-9b63-f8edec570b8e on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:43.475585 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:43.476228 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Checking segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:43.476764 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.477426 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Bound using segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:43.478043 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Bound port: 109db72b-debc-46ae-9b63-f8edec570b8e, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:43.479941 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.512154 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.615154 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] For port 109db72b-debc-46ae-9b63-f8edec570b8e, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:43.622111 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] For port 109db72b-debc-46ae-9b63-f8edec570b8e, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=109db72b-debc-46ae-9b63-f8edec570b8e,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:43.623878 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74fdda4a-5bb4-491c-867d-a444d79a0678 None None] Pushing event updated for resources: {'Port': ['ID=109db72b-debc-46ae-9b63-f8edec570b8e,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:43.674687 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Pushing event updated for resources: {'Port': ['ID=a1de646c-827f-41ad-bab9-8457e33db96d,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:43.691773 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bcef9095-47ef-4f28-9b50-94abd2b1f898 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.695615 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bcef9095-47ef-4f28-9b50-94abd2b1f898 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.700708 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-bcef9095-47ef-4f28-9b50-94abd2b1f898 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/64cba8f2-ecd4-48b5-beb4-19332243160e HTTP/1.1" status: 204 len: 168 time: 1.6623089 Jan 05 14:59:43.703810 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.727984 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:43.733226 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.735358 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-7cdfabb2-f165-449c-8dcb-1329b88093cd service neutron] 10.222.0.13 "PUT /v2.0/ports/a1de646c-827f-41ad-bab9-8457e33db96d HTTP/1.1" status: 200 len: 1093 time: 5.0123580 Jan 05 14:59:43.736094 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6cf86612-a721-4032-9b56-b9828fc658cd', 'tag': 'a1de646c-827f-41ad-bab9-8457e33db96d'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 14:59:43.743180 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.817402 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.956234 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-24ec615f-4d52-4cc5-ac58-f1ca474e852d None None] Provisioning complete for port 109db72b-debc-46ae-9b63-f8edec570b8e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:43.956704 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-24ec615f-4d52-4cc5-ac58-f1ca474e852d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:43.996179 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.027861 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74fdda4a-5bb4-491c-867d-a444d79a0678 None None] Pushing event updated for resources: {'Port': ['ID=109db72b-debc-46ae-9b63-f8edec570b8e,revision_number=4']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:44.068596 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcef9095-47ef-4f28-9b50-94abd2b1f898 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64cba8f2-ecd4-48b5-beb4-19332243160e,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:44.098081 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 2, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:44.309651 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:44.309651 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:44.310988 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'Port': ['ID=398afa2a-6e6d-493b-b78c-fc2dedf65aab,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:44.312673 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:44.314310 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-4b7636b9-844b-4331-b450-69e17239a63a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:44.314310 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-4b7636b9-844b-4331-b450-69e17239a63a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=fc623d81b10e491ab3a65d62b99bf7c7&device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 1096 time: 0.1737750 Jan 05 14:59:44.314847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-24ec615f-4d52-4cc5-ac58-f1ca474e852d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.315229 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4178b7c4-2481-42b2-8512-c6388a1db9a5 req-c8d616d1-e8f6-4115-9736-c369d8ff4bfa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.0373623 Jan 05 14:59:44.315558 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Checking router: 9ec87e52-56d6-4808-9eb4-61d2fe146230 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 14:59:44.315558 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Updating router 9ec87e52-56d6-4808-9eb4-61d2fe146230 port 179bc084-ed48-4658-9f6b-af880ff5322a binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 14:59:44.354342 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.365898 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-1fe6dddc-dcbd-41e9-a18e-231f225e7e36 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=a1de646c-827f-41ad-bab9-8457e33db96d HTTP/1.1" status: 200 len: 217 time: 0.1193397 Jan 05 14:59:44.461482 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-24ec615f-4d52-4cc5-ac58-f1ca474e852d None None] For port 109db72b-debc-46ae-9b63-f8edec570b8e, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=109db72b-debc-46ae-9b63-f8edec570b8e,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:44.463612 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:44.483001 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.486877 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-e843e212-2f96-4ba1-8015-9682f122c6a7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.9558756 Jan 05 14:59:44.511482 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:44.511482 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.518798 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770d1748-6437-40f6-8e64-8761d251c5ab req-375c3d05-f049-43bd-a8e1-b7f17c4a234d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:44.527597 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-770d1748-6437-40f6-8e64-8761d251c5ab req-375c3d05-f049-43bd-a8e1-b7f17c4a234d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.1646924 Jan 05 14:59:44.551850 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-1169955f-5b7d-489b-a2c9-282b5ad7aef2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:44.553511 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-1169955f-5b7d-489b-a2c9-282b5ad7aef2 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=851aa76f-ccc4-4997-b93f-8238639e6bfa HTTP/1.1" status: 200 len: 851 time: 0.1567883 Jan 05 14:59:44.605935 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-24ec615f-4d52-4cc5-ac58-f1ca474e852d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.681685 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-c2bcab2f-4b08-4f78-b0dc-893a93df1210 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fca65618-396e-44a0-8e47-55fa90240fd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1044407 Jan 05 14:59:44.687622 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-770d1748-6437-40f6-8e64-8761d251c5ab req-6285199c-0a46-4b87-8674-e9db74c852e6 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1583838 Jan 05 14:59:44.806234 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41694) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:44.831469 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-501eaab5-c559-4dbd-9216-3e3558ff968b admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.861005 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ec615f-4d52-4cc5-ac58-f1ca474e852d None None] Pushing event updated for resources: {'Port': ['ID=109db72b-debc-46ae-9b63-f8edec570b8e,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:44.861005 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-a4f7f9b8-6ede-4db2-a086-23d6497fd109 None None] Provisioning complete for port 109db72b-debc-46ae-9b63-f8edec570b8e triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:44.861005 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4f7f9b8-6ede-4db2-a086-23d6497fd109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:44.889308 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:43Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:44.995395 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31931453-d460-4b1c-8ed2-b7502457f2cd None None] The sync data for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi is: [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:43Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:59:45.022749 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-501eaab5-c559-4dbd-9216-3e3558ff968b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.120600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-501eaab5-c559-4dbd-9216-3e3558ff968b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.160708 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.237630 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501eaab5-c559-4dbd-9216-3e3558ff968b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4647baf-5070-4681-800b-08cde2a858d9,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:45.260558 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-501eaab5-c559-4dbd-9216-3e3558ff968b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=028a9f9aa13a4326a29c6545cb798a5c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4454207 Jan 05 14:59:45.260558 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 41702) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:45.336380 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-fed018c6-b4f0-4739-b60d-40a62e007460 service neutron] 10.222.0.13 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2730656 Jan 05 14:59:45.353125 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c2e4e748-47fa-4295-b426-5b905ad15071 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.398433 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c2e4e748-47fa-4295-b426-5b905ad15071 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.411436 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.551290 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b22e8164-1f27-453f-b63f-19d4447f903b req-02346a37-b0f1-4c48-ae26-1e387f956892 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.1211646 Jan 05 14:59:45.609574 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7369b8aa-13c3-46a1-8de6-46df8455ec4c None None] Pushing event updated for resources: {'Port': ['ID=179bc084-ed48-4658-9f6b-af880ff5322a,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:45.699703 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.13', 56438) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:45.737327 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9a711b2-5335-4f29-8f3f-ef32ed0ca57d req-f268b9e2-baed-4991-bed5-c29b82afb262 service neutron] 10.222.0.13 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2990139 Jan 05 14:59:45.768950 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c2e4e748-47fa-4295-b426-5b905ad15071 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.772284 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c2e4e748-47fa-4295-b426-5b905ad15071 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.773745 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c2e4e748-47fa-4295-b426-5b905ad15071 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d4647baf-5070-4681-800b-08cde2a858d9 HTTP/1.1" status: 204 len: 168 time: 0.5089445 Jan 05 14:59:45.808839 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e4e748-47fa-4295-b426-5b905ad15071 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4647baf-5070-4681-800b-08cde2a858d9,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:45.942900 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Attempting to bind port 179bc084-ed48-4658-9f6b-af880ff5322a on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:45.951707 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Attempting to bind port 179bc084-ed48-4658-9f6b-af880ff5322a by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:45.951707 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Attempting to bind port 179bc084-ed48-4658-9f6b-af880ff5322a on network 1c375b41-1339-4d14-93e7-e473aa7e6978 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:45.985445 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:45.987158 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Checking segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:45.996212 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:45.999015 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Bound using segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:46.003001 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Bound port: 179bc084-ed48-4658-9f6b-af880ff5322a, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:46.005503 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:46.127374 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-badd7812-6370-4a45-878f-13d1e8fbd5a8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1690308885&fields=id&tenant_id=715006ffd8ba4e5b963511ec759ae152 HTTP/1.1" status: 200 len: 267 time: 0.2780750 Jan 05 14:59:46.141612 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82358378-d22c-4b96-bc0b-7d24ac42e2ab" -d '{"events": [{"name": "network-changed", "server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 14:59:46.273983 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 109db72b-debc-46ae-9b63-f8edec570b8e up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:46.617899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] For port 179bc084-ed48-4658-9f6b-af880ff5322a, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:46.617899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] For port 179bc084-ed48-4658-9f6b-af880ff5322a, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=179bc084-ed48-4658-9f6b-af880ff5322a,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:46.617899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-95227e80-36b3-4d10-932f-854cf3382cb0 None None] Provisioning complete for port 179bc084-ed48-4658-9f6b-af880ff5322a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:46.617899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-95227e80-36b3-4d10-932f-854cf3382cb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:46.620920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-709717e8-5ff5-410b-a207-a64d4565c614 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:46.622104 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-ee43efea-5618-443d-8c23-9f46e65c3189 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:46.622659 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-709717e8-5ff5-410b-a207-a64d4565c614 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 810 time: 0.3243558 Jan 05 14:59:46.623077 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-ee43efea-5618-443d-8c23-9f46e65c3189 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 819 time: 0.7755814 Jan 05 14:59:46.623443 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-9f702772-01e8-4182-af77-b1a2a138e05c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/quotas/715006ffd8ba4e5b963511ec759ae152 HTTP/1.1" status: 200 len: 375 time: 0.0109222 Jan 05 14:59:46.623530 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Request body: {'port': {'device_id': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'admin_state_up': True, 'tenant_id': '9c7d005c6e9e454fa506907144639917'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:46.623736 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-95227e80-36b3-4d10-932f-854cf3382cb0 None None] Port 179bc084-ed48-4658-9f6b-af880ff5322a cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:59:46.623736 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 109db72b-debc-46ae-9b63-f8edec570b8e triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:46.623736 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:46.635217 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-4b6bd931-9a48-42a6-9f12-0d3cc095a5db tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1277132 Jan 05 14:59:46.694786 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41744) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:46.728871 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-2ce67b13-be46-4e33-b9f9-de34fe0bf978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1078732531', 'description': 'tempest-description--1406678621'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:46.740187 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:46.790450 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0e6bba9-968e-431f-a1e6-30c4197065d7 req-0362cc63-88fa-473e-8d6d-c0b97298e6ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:46.808497 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e0e6bba9-968e-431f-a1e6-30c4197065d7 req-0362cc63-88fa-473e-8d6d-c0b97298e6ad tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.2369552 Jan 05 14:59:46.901986 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 14:59:46.902723 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T14:59:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:46.973759 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-f51a31fd-46d7-4494-9f72-f0100f1e1111 service neutron] 10.222.0.30 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2874072 Jan 05 14:59:47.018337 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e0e6bba9-968e-431f-a1e6-30c4197065d7 req-aa8e9980-52e4-4b9e-bc0a-166f5346e855 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2077770 Jan 05 14:59:47.052549 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7369b8aa-13c3-46a1-8de6-46df8455ec4c None None] Pushing event updated for resources: {'Port': ['ID=179bc084-ed48-4658-9f6b-af880ff5322a,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:47.182824 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2ce67b13-be46-4e33-b9f9-de34fe0bf978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:47.240884 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-4f89f478-845a-432a-84c3-dfda3d17009c service neutron] 10.222.0.30 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1581707 Jan 05 14:59:47.254837 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 14:59:47.286240 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-74a9acdd-8813-4a42-835f-46360385936f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:47.289159 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-74a9acdd-8813-4a42-835f-46360385936f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 819 time: 0.3139420 Jan 05 14:59:47.340602 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Request body: {'port': {'device_id': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'admin_state_up': True, 'tenant_id': '9c7d005c6e9e454fa506907144639917'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:47.386086 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2ce67b13-be46-4e33-b9f9-de34fe0bf978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:47.402815 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Made reservation on behalf of 9c7d005c6e9e454fa506907144639917 for: {'port': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:47.407144 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:47.572063 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-bc7e3596-74f8-4717-83ca-97fb947ea632 None None] Provisioning complete for port 179bc084-ed48-4658-9f6b-af880ff5322a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:47.572659 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bc7e3596-74f8-4717-83ca-97fb947ea632 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:47.826080 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bc7e3596-74f8-4717-83ca-97fb947ea632 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:47.868365 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Made reservation on behalf of 9c7d005c6e9e454fa506907144639917 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:47.876454 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:47.985101 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Allocated IP 172.20.0.9 (975fa447-11a2-47cd-86bf-82619c2a8abd/05f78cb6-38bd-4a95-a1d0-4c4654bbd075/7e97ea9f-9968-4d12-a26d-c48d64741cea) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:47.997871 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 14:59:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 x-openstack-request-id: req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 14:59:48.001594 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 14:59:48.001957 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f868446b-9b2b-45b9-8ff0-8d4c0500a734 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 14:59:48.002447 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6cf86612-a721-4032-9b56-b9828fc658cd', 'tag': 'a1de646c-827f-41ad-bab9-8457e33db96d', 'status': 'completed', 'code': 200} Jan 05 14:59:48.012283 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.13', 56443) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:48.025260 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-bc7e3596-74f8-4717-83ca-97fb947ea632 None None] For port 179bc084-ed48-4658-9f6b-af880ff5322a, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=179bc084-ed48-4658-9f6b-af880ff5322a,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:48.060642 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2ce67b13-be46-4e33-b9f9-de34fe0bf978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:48.089130 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:46Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 14:59:48.092409 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bc7e3596-74f8-4717-83ca-97fb947ea632 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:48.156040 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08f1b765-e37c-4244-8fec-ab1ec1fb6fcb None None] The sync data for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi is: [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:46Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 14:59:48.373300 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-375a1315-4455-4b89-bbff-bb85dcae1965 req-88a0eaa4-0955-40e5-822c-a0ac0489bb7d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.2176564 Jan 05 14:59:48.402125 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-15368232-c73b-454b-9008-e77fae595d74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:48.407968 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7e3596-74f8-4717-83ca-97fb947ea632 None None] Pushing event updated for resources: {'Port': ['ID=179bc084-ed48-4658-9f6b-af880ff5322a,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:48.413456 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7c9dd50a-8697-44e1-b8b7-c5d841a88556 req-b83a7020-9f59-4354-8d0c-849704c18a40 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.3748407 Jan 05 14:59:48.414113 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-15368232-c73b-454b-9008-e77fae595d74 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=fc623d81b10e491ab3a65d62b99bf7c7&device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 1096 time: 0.3951550 Jan 05 14:59:48.448715 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2ce67b13-be46-4e33-b9f9-de34fe0bf978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:48.452922 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2ce67b13-be46-4e33-b9f9-de34fe0bf978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.7437875 Jan 05 14:59:48.475099 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41782) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:48.610042 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-82dd5a33-07ae-4291-847d-ca8bbc9b0af0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'security_group_rule': {'security_group_id': 'f3335da6-9782-4236-8228-e5257a8ab1ba', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:48.719417 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce67b13-be46-4e33-b9f9-de34fe0bf978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3335da6-9782-4236-8228-e5257a8ab1ba,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:48.808065 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 req-369d6db0-6e71-44ea-9b50-730b204a207e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:48.816644 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 req-369d6db0-6e71-44ea-9b50-730b204a207e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.2189763 Jan 05 14:59:48.847165 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-aa8b82fb-3e46-4103-bb67-2591b34f447d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:48.853286 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-aa8b82fb-3e46-4103-bb67-2591b34f447d service neutron] 10.222.0.13 "GET /v2.0/networks?id=fca65618-396e-44a0-8e47-55fa90240fd2 HTTP/1.1" status: 200 len: 912 time: 0.4251969 Jan 05 14:59:48.900791 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:49.143627 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:49.243340 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-c5899dae-d4ee-4756-9f6a-ec7e65bf53d9 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=a1de646c-827f-41ad-bab9-8457e33db96d HTTP/1.1" status: 200 len: 217 time: 0.3712249 Jan 05 14:59:49.352642 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Network 975fa447-11a2-47cd-86bf-82619c2a8abd is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:49.353680 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80a6dbd7-c3b5-41a5-98ab-bcac856b9ba8 req-56c57d85-0477-4f29-9a00-5eb029b99bc3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5296423 Jan 05 14:59:49.360120 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:49.400132 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:49.453639 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:49.454285 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:49.490506 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Pushing event updated for resources: {'Port': ['ID=7e97ea9f-9968-4d12-a26d-c48d64741cea,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:49.526963 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82dd5a33-07ae-4291-847d-ca8bbc9b0af0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:49.564790 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-30235f70-ad7b-4db2-aabd-f1e1f76766b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:49.566490 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-30235f70-ad7b-4db2-aabd-f1e1f76766b2 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=851aa76f-ccc4-4997-b93f-8238639e6bfa HTTP/1.1" status: 200 len: 851 time: 0.2573867 Jan 05 14:59:49.628781 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-3e1ed3bd-6e82-4604-8bbd-ae07cddcdfff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.1178195 Jan 05 14:59:49.630723 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-52b4bee3-f909-49ef-809a-876cb2f3a90d req-343a4073-45a6-423f-97f0-c1458f17ac9c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.0542016 Jan 05 14:59:49.679975 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-89fc33d9-3b45-4c00-a308-3f0540ad53df service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fca65618-396e-44a0-8e47-55fa90240fd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0480113 Jan 05 14:59:49.687438 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f78ac0a3-825b-411b-b913-84c6d8c9ecab req-2d6374c3-2ff1-455c-ab53-23ac34909977 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.1041870 Jan 05 14:59:49.700117 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Request body: {'port': {'device_id': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:49.728193 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Allocated IP 172.20.0.14 (975fa447-11a2-47cd-86bf-82619c2a8abd/05f78cb6-38bd-4a95-a1d0-4c4654bbd075/94077c14-de44-48f3-8ca4-3b1be238b708) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:49.862915 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-58379cc6-c047-48a1-8668-abec75d59827 service neutron] 10.222.0.13 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1604958 Jan 05 14:59:49.933005 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:49.987924 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-82358378-d22c-4b96-bc0b-7d24ac42e2ab req-3ddd4b0a-1b0b-44a4-8f7d-35f68d449e65 service neutron] 10.222.0.13 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1084847 Jan 05 14:59:49.991083 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82dd5a33-07ae-4291-847d-ca8bbc9b0af0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.059374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 179bc084-ed48-4658-9f6b-af880ff5322a up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 14:59:50.171510 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82dd5a33-07ae-4291-847d-ca8bbc9b0af0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.183511 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.235007 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82dd5a33-07ae-4291-847d-ca8bbc9b0af0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=32d60537-13e1-4c80-a91a-61fdeec69c63,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:50.253870 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 179bc084-ed48-4658-9f6b-af880ff5322a triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:50.254241 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.375538 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.508125 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82dd5a33-07ae-4291-847d-ca8bbc9b0af0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.509619 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-82dd5a33-07ae-4291-847d-ca8bbc9b0af0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.9297559 Jan 05 14:59:50.520588 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41834) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:50.526069 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-154acc29-aab7-48c9-92bc-01f5eb1b1b73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'security_group_rule': {'security_group_id': 'f3335da6-9782-4236-8228-e5257a8ab1ba', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:50.739589 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Network 975fa447-11a2-47cd-86bf-82619c2a8abd is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:50.749504 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:50.755623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:50.773891 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:50.774722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.797990 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Pushing event updated for resources: {'Port': ['ID=94077c14-de44-48f3-8ca4-3b1be238b708,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:50.809202 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7e97ea9f-9968-4d12-a26d-c48d64741cea {{(pid=114655) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: from cryptography.utils import int_from_bytes Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: from cryptography.utils import int_from_bytes Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.820810 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:50.823132 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:50.827033 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e req-fc9005a7-a39f-42d3-9929-69914753b21f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:50.828655 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e req-fc9005a7-a39f-42d3-9929-69914753b21f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.2103195 Jan 05 14:59:50.837426 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3dfa364a-5069-4add-803f-8330eb85352b req-6d367016-c4e3-4fc6-a964-5c26a9601b47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.0536463 Jan 05 14:59:50.839481 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:50.869307 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.provisioning_blocks [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Transition to ACTIVE for port object 7e97ea9f-9968-4d12-a26d-c48d64741cea will not be triggered until provisioned by entity L2. {{(pid=114655) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 14:59:50.911550 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1d9d91dd-f6a2-4ea0-a3c8-01aa9ba9782e req-b29d721e-e60f-4b46-9ba3-36150d8016d7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763252 Jan 05 14:59:50.992329 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 req-b578502e-7e43-4da3-9a54-fedd97650b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:50.993907 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 req-b578502e-7e43-4da3-9a54-fedd97650b10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 932 time: 0.0525784 Jan 05 14:59:51.040495 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0859baaf-4d67-4e90-bb59-f914fe08ceb5 req-f0313a12-c6f6-4f3b-a517-fde2f68f941f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409653 Jan 05 14:59:51.093022 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-154acc29-aab7-48c9-92bc-01f5eb1b1b73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.142702 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-154acc29-aab7-48c9-92bc-01f5eb1b1b73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.145307 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.154919 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-e15a97af-d44b-4992-8e1e-bcb04b99c54f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.8185613 Jan 05 14:59:51.225478 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Pushing event updated for resources: {'Port': ['ID=7e97ea9f-9968-4d12-a26d-c48d64741cea,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:51.253653 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-154acc29-aab7-48c9-92bc-01f5eb1b1b73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.274522 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.managers [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Attempting to bind port 7e97ea9f-9968-4d12-a26d-c48d64741cea on host hv-cinder-maste for vnic_type normal with profile {{(pid=114655) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:51.276673 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.managers [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Attempting to bind port 7e97ea9f-9968-4d12-a26d-c48d64741cea by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'}] {{(pid=114655) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:51.276673 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Attempting to bind port 7e97ea9f-9968-4d12-a26d-c48d64741cea on network 975fa447-11a2-47cd-86bf-82619c2a8abd {{(pid=114655) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:51.282473 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154acc29-aab7-48c9-92bc-01f5eb1b1b73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0de6b051-fcdc-424c-a93e-66b2b733da90,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:51.285144 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Port 7e97ea9f-9968-4d12-a26d-c48d64741cea on network 975fa447-11a2-47cd-86bf-82619c2a8abd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114655) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 14:59:51.285481 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Attempting to bind port 7e97ea9f-9968-4d12-a26d-c48d64741cea on network 975fa447-11a2-47cd-86bf-82619c2a8abd {{(pid=114655) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:51.290752 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114655) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:51.291601 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Checking segment: {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:51.291755 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Bound using segment: {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'} {{(pid=114655) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:51.292106 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.managers [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Bound port: 7e97ea9f-9968-4d12-a26d-c48d64741cea, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'}}] {{(pid=114655) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:51.292515 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.345395 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Request body: {'port': {'device_id': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:51.362890 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] For port 7e97ea9f-9968-4d12-a26d-c48d64741cea, host hv-cinder-maste, cleared binding levels {{(pid=114655) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:51.367596 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] For port 7e97ea9f-9968-4d12-a26d-c48d64741cea, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114655) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:51.381518 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-154acc29-aab7-48c9-92bc-01f5eb1b1b73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.382744 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-154acc29-aab7-48c9-92bc-01f5eb1b1b73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8610103 Jan 05 14:59:51.385719 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 41852) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 14:59:51.396646 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:51.403414 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.482986 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.521552 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.536933 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:51.537958 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.539612 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] 10.222.0.13 "PUT /v2.0/ports/7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 1093 time: 1.8563371 Jan 05 14:59:51.541187 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'tag': '7e97ea9f-9968-4d12-a26d-c48d64741cea'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 14:59:51.859205 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 94077c14-de44-48f3-8ca4-3b1be238b708 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 14:59:51.869883 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25b154f-6b21-4caf-9526-f75a5033eff0 service neutron] Pushing event updated for resources: {'Port': ['ID=7e97ea9f-9968-4d12-a26d-c48d64741cea,revision_number=3']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:51.870952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:51.899790 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Transition to ACTIVE for port object 94077c14-de44-48f3-8ca4-3b1be238b708 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 14:59:51.969884 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-72eab655-ce91-4c37-8b7f-b79b751197ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:51.969884 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-72eab655-ce91-4c37-8b7f-b79b751197ea service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1096 time: 0.1432798 Jan 05 14:59:52.040211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:52.068843 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-14e0582e-31b0-4484-a1e7-3f2b9e8ff122 req-756066de-40d3-4860-86a9-464df8eb7b08 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.1046815 Jan 05 14:59:52.123187 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-77abb5e3-2e22-4bb7-84d4-8021b25b9437 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 217 time: 0.1335728 Jan 05 14:59:52.221548 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a29c664b-2b9f-4817-9471-e3c87169e13b" -d '{"events": [{"name": "network-changed", "server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 14:59:52.254327 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Pushing event updated for resources: {'Port': ['ID=94077c14-de44-48f3-8ca4-3b1be238b708,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:52.275950 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Attempting to bind port 94077c14-de44-48f3-8ca4-3b1be238b708 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:52.279099 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Attempting to bind port 94077c14-de44-48f3-8ca4-3b1be238b708 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:52.279099 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Attempting to bind port 94077c14-de44-48f3-8ca4-3b1be238b708 on network 975fa447-11a2-47cd-86bf-82619c2a8abd {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:52.279728 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672d017b-65c7-4c32-94e2-808a1592bfe2 req-0a611662-82aa-4ac9-94a3-5798297eae16 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:52.281641 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-672d017b-65c7-4c32-94e2-808a1592bfe2 req-0a611662-82aa-4ac9-94a3-5798297eae16 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.1960692 Jan 05 14:59:52.287230 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Port 94077c14-de44-48f3-8ca4-3b1be238b708 on network 975fa447-11a2-47cd-86bf-82619c2a8abd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 14:59:52.288066 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:52.288407 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Attempting to bind port 94077c14-de44-48f3-8ca4-3b1be238b708 on network 975fa447-11a2-47cd-86bf-82619c2a8abd {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:52.290751 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-28d9bb91-5186-4ba2-8380-9518e13c3d56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:52.292408 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-28d9bb91-5186-4ba2-8380-9518e13c3d56 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.1296747 Jan 05 14:59:52.307884 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd82f33e-c18d-4471-8279-89efd71de7f9 req-8842022b-95b4-4554-9271-9a8ece391552 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:52.309588 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dd82f33e-c18d-4471-8279-89efd71de7f9 req-8842022b-95b4-4554-9271-9a8ece391552 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.1091745 Jan 05 14:59:52.310576 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:52.310902 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Checking segment: {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:52.311336 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Bound using segment: {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:52.312299 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Bound port: 94077c14-de44-48f3-8ca4-3b1be238b708, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '837624e7-6703-4540-ba8b-9f16e4400b5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:52.312656 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:52.371392 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-59433eff-2b43-4f4c-8e62-eefd751b1592 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0653284 Jan 05 14:59:52.420368 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] For port 94077c14-de44-48f3-8ca4-3b1be238b708, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:52.428519 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] For port 94077c14-de44-48f3-8ca4-3b1be238b708, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=94077c14-de44-48f3-8ca4-3b1be238b708,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:52.493240 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-672d017b-65c7-4c32-94e2-808a1592bfe2 req-3390f14d-f63d-41bc-bfa9-a5ea3370bbfb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1947396 Jan 05 14:59:52.568578 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-9b3fcf12-3eb4-4b9c-b0dd-a6e4d2643327 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1620767 Jan 05 14:59:52.568578 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Allocated IP 172.37.2.180 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/8c032186-94a7-4a52-9b24-bccd5b79baa5) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:52.615191 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:52.731066 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dd82f33e-c18d-4471-8279-89efd71de7f9 req-a5d5f4ae-c733-48bd-abd9-08d412dccba1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3883865 Jan 05 14:59:52.733335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:52.735018 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:52.737759 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] 10.222.0.13 "PUT /v2.0/ports/94077c14-de44-48f3-8ca4-3b1be238b708 HTTP/1.1" status: 200 len: 1094 time: 1.3969531 Jan 05 14:59:52.743698 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'tag': '94077c14-de44-48f3-8ca4-3b1be238b708'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 14:59:52.746961 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf456769-4696-45e5-8638-88499e07b687" -d '{"events": [{"name": "network-changed", "server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 14:59:52.767127 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 14:59:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 x-openstack-request-id: req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 14:59:52.767127 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 14:59:52.767127 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-22f1f9b9-1c66-44ae-8f16-937f6872eec0 {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 14:59:52.767127 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'tag': '7e97ea9f-9968-4d12-a26d-c48d64741cea', 'status': 'completed', 'code': 200} Jan 05 14:59:52.790392 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-4fcfba08-14aa-4a52-bffe-4ff412a12d67 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:52.792138 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-4fcfba08-14aa-4a52-bffe-4ff412a12d67 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 810 time: 0.3663054 Jan 05 14:59:52.816597 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51359e3d-13e8-4070-84fc-ce6f3148a524 req-474b33be-57f4-4dd6-8997-86e757df8b20 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2461371 Jan 05 14:59:52.821540 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f90988c-de7c-440a-9c9b-bbab20527d7b service neutron] Pushing event updated for resources: {'Port': ['ID=94077c14-de44-48f3-8ca4-3b1be238b708,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:52.852252 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:52.894006 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-a130ed59-efff-4e29-9a6e-2cead9c64cd9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=715006ffd8ba4e5b963511ec759ae152 HTTP/1.1" status: 200 len: 380 time: 0.0877202 Jan 05 14:59:52.895509 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 14:59:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-500cc71f-b44e-4053-8ebe-043fce94dfd5 x-openstack-request-id: req-500cc71f-b44e-4053-8ebe-043fce94dfd5 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 14:59:52.895801 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 14:59:52.896050 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-500cc71f-b44e-4053-8ebe-043fce94dfd5 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 14:59:52.896435 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'tag': '94077c14-de44-48f3-8ca4-3b1be238b708', 'status': 'completed', 'code': 200} Jan 05 14:59:52.923395 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'port': {'device_id': '3327c27f-a8e9-4b19-8041-fb5260278159', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'admin_state_up': True, 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'security_groups': ['552b70d6-a366-4dff-9b66-b1679ffedd08']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:52.967651 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:53.023528 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:53.033430 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:53.036872 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf456769-4696-45e5-8638-88499e07b687 req-66e8deff-66a4-43c0-afed-a4f5279e6e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.038613 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bf456769-4696-45e5-8638-88499e07b687 req-66e8deff-66a4-43c0-afed-a4f5279e6e55 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 1097 time: 0.1075203 Jan 05 14:59:53.039343 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:53.043073 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'Port': ['ID=8c032186-94a7-4a52-9b24-bccd5b79baa5,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:53.118580 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-fb879e12-9df2-4fa7-a9de-bdf55c6b3d2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.119802 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-fb879e12-9df2-4fa7-a9de-bdf55c6b3d2d service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1096 time: 0.0706301 Jan 05 14:59:53.208722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Made reservation on behalf of 715006ffd8ba4e5b963511ec759ae152 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 14:59:53.213369 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:53.218148 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:53.221014 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f75856bc-3791-4c2c-8b93-9fe593e09225 req-929bf83b-0092-47a3-86e7-e5306f126b2e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.0615151 Jan 05 14:59:53.281959 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf456769-4696-45e5-8638-88499e07b687 req-f9b774f9-a38e-4bf2-a3cf-ff1269c434ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.283397 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bf456769-4696-45e5-8638-88499e07b687 req-f9b774f9-a38e-4bf2-a3cf-ff1269c434ef service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=9c7d005c6e9e454fa506907144639917&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2320077 Jan 05 14:59:53.309335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-a7f5e283-80d3-49ee-ae88-6fcc1daae7e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.310825 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-a7f5e283-80d3-49ee-ae88-6fcc1daae7e4 service neutron] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 920 time: 0.1708059 Jan 05 14:59:53.370756 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-11517a39-6be6-42c1-89bd-c139f2395cc9 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 217 time: 0.0445814 Jan 05 14:59:53.447780 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:53.449169 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Allocated IP 172.20.0.8 (fb7bcda7-5039-4d82-bf68-12c9acc8a744/fd51f09d-6379-4a7e-97a4-fafd6cf55180/2886de19-8aa3-470c-a593-9381bdb36ca0) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 14:59:53.455896 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-7158b88f-626f-4655-873f-28c16dd22472 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.457416 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-7158b88f-626f-4655-873f-28c16dd22472 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0687344 Jan 05 14:59:53.505996 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-577e45be-e000-43fc-aaf2-4021627e14e8 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0403957 Jan 05 14:59:53.662743 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf456769-4696-45e5-8638-88499e07b687 req-5e5a3814-ac81-44fb-a904-03a46e21ffe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.664211 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bf456769-4696-45e5-8638-88499e07b687 req-5e5a3814-ac81-44fb-a904-03a46e21ffe1 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3741498 Jan 05 14:59:53.685188 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:53.726222 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c46c97-9f7a-4c78-adef-3021654624a1 req-10752ac8-5143-47b2-808b-3779474a04ba tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.727663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-20c46c97-9f7a-4c78-adef-3021654624a1 req-10752ac8-5143-47b2-808b-3779474a04ba tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.1396153 Jan 05 14:59:53.764670 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-e06e6240-1bd8-4bc5-8118-63384e7c51bb service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2474065 Jan 05 14:59:53.770709 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-893b6312-6620-45f3-851e-e2b60fefe815 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:53.772266 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-893b6312-6620-45f3-851e-e2b60fefe815 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 1097 time: 0.0412736 Jan 05 14:59:53.774024 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:53.809751 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:53.887293 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-20c46c97-9f7a-4c78-adef-3021654624a1 req-1e898bd3-05ad-42a3-a843-036c985c6b50 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1536880 Jan 05 14:59:53.928120 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a29c664b-2b9f-4817-9471-e3c87169e13b req-2e34f937-a521-4641-90ac-8e7d99af9e53 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1499338 Jan 05 14:59:54.026619 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:54.044475 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-76a6b76f-102d-4a11-8158-f3119cf20a8e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=94077c14-de44-48f3-8ca4-3b1be238b708 HTTP/1.1" status: 200 len: 217 time: 0.0659573 Jan 05 14:59:54.077005 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:54.091679 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'Port': ['ID=8c032186-94a7-4a52-9b24-bccd5b79baa5,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:54.120340 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 req-97bcff7c-efde-4980-b483-d7e3a8156cfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:54.121850 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 req-97bcff7c-efde-4980-b483-d7e3a8156cfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.1423082 Jan 05 14:59:54.126051 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-d40f0a85-4c97-4176-95e0-f70db5d957f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:54.127484 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-d40f0a85-4c97-4176-95e0-f70db5d957f9 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0729012 Jan 05 14:59:54.130225 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 14:59:54.133555 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 14:59:54.140677 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 14:59:54.146468 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:54.147089 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:54.158030 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'Port': ['ID=2886de19-8aa3-470c-a593-9381bdb36ca0,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:54.166912 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-fa7b17b0-9d40-4314-89a8-6ac820d030a9 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0321298 Jan 05 14:59:54.171965 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:54.171965 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-563b1332-16fc-49a1-b1bf-e6ea97153f9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.7843544 Jan 05 14:59:54.226517 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-050657a5-53cc-4203-908b-9d7ba19f39cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3066516 Jan 05 14:59:54.243860 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Request body: {'port': {'device_id': '3327c27f-a8e9-4b19-8041-fb5260278159', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 14:59:54.243983 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fb28e40a-e499-4df9-8fc4-5a71f4c106e8 req-8fe5296b-939d-4e6d-8151-084cf39a7da2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148789 Jan 05 14:59:54.352006 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:54.389496 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-9aa10cdc-1c35-4326-9153-a028d8d6128c service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2144527 Jan 05 14:59:54.525346 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-f504dfa6-d902-4297-af8b-2d650544b66c None None] Provisioning complete for port 2886de19-8aa3-470c-a593-9381bdb36ca0 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 14:59:54.525993 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f504dfa6-d902-4297-af8b-2d650544b66c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:54.578976 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-f504dfa6-d902-4297-af8b-2d650544b66c None None] Port 2886de19-8aa3-470c-a593-9381bdb36ca0 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 14:59:54.629579 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c req-65f73653-2db1-4dff-b562-55704658df59 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:54.637202 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c req-65f73653-2db1-4dff-b562-55704658df59 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 931 time: 0.1484280 Jan 05 14:59:54.653004 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-a5d5fc5e-fc37-4b58-9793-2df355349f8d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1078732531&fields=id&tenant_id=f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 267 time: 0.1317711 Jan 05 14:59:54.683732 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-07324ee1-9d75-4737-b7a5-cba91160b05d req-8b62844d-25a0-41ce-b3b3-f95ee205a715 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2858799 Jan 05 14:59:54.739207 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b5e7c5f1-2b45-4642-8cf9-2bf4187ba65c req-4049242c-501f-40c3-a44e-cb2d63ed0026 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1008809 Jan 05 14:59:54.781390 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-404ceddc-ec05-4024-a5b7-997ddd26e0a6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:54.782969 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-404ceddc-ec05-4024-a5b7-997ddd26e0a6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 817 time: 0.1226242 Jan 05 14:59:54.798097 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-e4b425bb-ca44-4b0d-a5d8-b873f24e5a97 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/quotas/f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 375 time: 0.0091240 Jan 05 14:59:54.811506 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2886de19-8aa3-470c-a593-9381bdb36ca0 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 14:59:54.819514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:54.837873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Transition to ACTIVE for port object 2886de19-8aa3-470c-a593-9381bdb36ca0 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 14:59:54.850936 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-a7a286a5-9b40-4a58-9f8c-34ed0ea1c99e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0453258 Jan 05 14:59:54.971845 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-545dd9ca-e49e-40dd-ac6f-66df068785c4 service neutron] 10.222.0.30 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1057868 Jan 05 14:59:55.002017 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:55.062974 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-787706f0-f49d-4ff5-a67e-c67d9aa7f30a service neutron] 10.222.0.30 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901279 Jan 05 14:59:55.063436 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Pushing event updated for resources: {'Port': ['ID=2886de19-8aa3-470c-a593-9381bdb36ca0,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:55.074260 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485add66-b327-4b21-9466-b8ffdd84aa1c req-747db92e-bed2-4a3c-8b35-741f8f047476 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:55.075837 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-485add66-b327-4b21-9466-b8ffdd84aa1c req-747db92e-bed2-4a3c-8b35-741f8f047476 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.1021526 Jan 05 14:59:55.124065 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Attempting to bind port 2886de19-8aa3-470c-a593-9381bdb36ca0 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 14:59:55.124971 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Attempting to bind port 2886de19-8aa3-470c-a593-9381bdb36ca0 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 14:59:55.125337 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Attempting to bind port 2886de19-8aa3-470c-a593-9381bdb36ca0 on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:55.137734 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Port 2886de19-8aa3-470c-a593-9381bdb36ca0 on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 14:59:55.138064 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Attempting to bind port 2886de19-8aa3-470c-a593-9381bdb36ca0 on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 14:59:55.151128 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 14, 59, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 14:59:55.151473 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Checking segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 14:59:55.151863 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Bound using segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 14:59:55.152311 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Bound port: 2886de19-8aa3-470c-a593-9381bdb36ca0, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 14:59:55.152668 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:55.168016 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-485add66-b327-4b21-9466-b8ffdd84aa1c req-215deed8-e457-4856-974d-3bb76461b2a2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0863369 Jan 05 14:59:55.230660 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] For port 2886de19-8aa3-470c-a593-9381bdb36ca0, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 14:59:55.234491 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] For port 2886de19-8aa3-470c-a593-9381bdb36ca0, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2886de19-8aa3-470c-a593-9381bdb36ca0,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 14:59:55.331885 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:55.381261 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a979983a-b7cc-4394-a254-4948b3b324b1 req-eeca6f2e-24b5-4638-962a-2a50a35df058 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0293043 Jan 05 14:59:55.423596 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:55.424138 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:55.425761 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] 10.222.0.13 "PUT /v2.0/ports/2886de19-8aa3-470c-a593-9381bdb36ca0 HTTP/1.1" status: 200 len: 1093 time: 1.1877065 Jan 05 14:59:55.427519 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 14:59:55.429860 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7" -d '{"events": [{"name": "network-changed", "server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.455704 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 14:59:55.457621 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 14:59:55.459118 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da71097d-2255-42b5-b884-c6238886ac74 req-f1c27742-4854-44e2-8e11-8f90c7039343 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:55.460669 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da71097d-2255-42b5-b884-c6238886ac74 req-f1c27742-4854-44e2-8e11-8f90c7039343 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.1366572 Jan 05 14:59:55.461794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780cbbc9-bfa7-4531-a0c9-d82835ac1a88 service neutron] Pushing event updated for resources: {'Port': ['ID=2886de19-8aa3-470c-a593-9381bdb36ca0,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:55.511834 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 14:59:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-223213b4-5406-463a-b4be-709151142195 x-openstack-request-id: req-223213b4-5406-463a-b4be-709151142195 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 14:59:55.513219 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 14:59:55.514732 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-223213b4-5406-463a-b4be-709151142195 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 14:59:55.514732 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'status': 'completed', 'code': 200} Jan 05 14:59:55.565303 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da71097d-2255-42b5-b884-c6238886ac74 req-3ff425f8-fbfa-4add-af4b-2af5de79c638 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837438 Jan 05 14:59:55.858952 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0346f390-8886-4eae-bac0-c4ff4df6ae1b req-1aca6ba1-9631-430e-85fe-8c892b292b02 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:55.860331 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0346f390-8886-4eae-bac0-c4ff4df6ae1b req-1aca6ba1-9631-430e-85fe-8c892b292b02 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0539372 Jan 05 14:59:55.905515 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0346f390-8886-4eae-bac0-c4ff4df6ae1b req-87d657b0-8b54-44b1-b000-f709eea44f66 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395107 Jan 05 14:59:56.289805 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af34513a-7d43-46fc-bbd3-b23c07acb77c req-8188bcac-211e-4d8b-95ae-6d96861363c4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:56.291275 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-af34513a-7d43-46fc-bbd3-b23c07acb77c req-8188bcac-211e-4d8b-95ae-6d96861363c4 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.0524569 Jan 05 14:59:56.337154 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-af34513a-7d43-46fc-bbd3-b23c07acb77c req-66edd1bb-75ed-4a78-a258-816c9d1c7a37 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402188 Jan 05 14:59:56.466761 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a37a0e20-fc8b-4dff-8d9c-65447c68812f req-2910c0f5-9fed-46fd-96c8-3d27e048a941 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0249224 Jan 05 14:59:56.678535 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a076d6f-e508-4ead-953f-38639ad04e11 req-2766f5bd-0679-44c8-9d4f-02391c501137 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:56.679978 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0a076d6f-e508-4ead-953f-38639ad04e11 req-2766f5bd-0679-44c8-9d4f-02391c501137 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0486038 Jan 05 14:59:56.724416 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0a076d6f-e508-4ead-953f-38639ad04e11 req-9d6acf96-e37a-461a-95bf-dfea816f8e2c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388720 Jan 05 14:59:57.015754 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68fba021-9497-4ec6-8c39-20ffcd080ff1 req-eda13394-915e-4d5c-8d9d-e20a760d3f2e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:57.017248 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-68fba021-9497-4ec6-8c39-20ffcd080ff1 req-eda13394-915e-4d5c-8d9d-e20a760d3f2e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0478213 Jan 05 14:59:57.062930 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-68fba021-9497-4ec6-8c39-20ffcd080ff1 req-a7c787c2-926f-445c-b9eb-2131535091d9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401809 Jan 05 14:59:57.124384 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 7e97ea9f-9968-4d12-a26d-c48d64741cea details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 14:59:57.228939 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 7e97ea9f-9968-4d12-a26d-c48d64741cea, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:57.231852 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-fa243604-e1a9-41c1-a899-c6f1654facc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:57.233372 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-fa243604-e1a9-41c1-a899-c6f1654facc3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 1096 time: 0.0422680 Jan 05 14:59:57.241196 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '7e97ea9f-9968-4d12-a26d-c48d64741cea', 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'port_id': '7e97ea9f-9968-4d12-a26d-c48d64741cea', 'mac_address': 'fa:16:3e:6e:62:db', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 14:59:57.278118 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:57.290672 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7e97ea9f-9968-4d12-a26d-c48d64741cea {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 14:59:57.312121 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 7e97ea9f-9968-4d12-a26d-c48d64741cea, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:57.439993 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:57.440785 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a1de646c-827f-41ad-bab9-8457e33db96d details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 14:59:57.502322 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=7e97ea9f-9968-4d12-a26d-c48d64741cea,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:57.597008 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3e0572e1-0ed2-4bea-b686-efe7e27e16c2 req-6ce4090b-8848-4fb4-a6a8-897d4c703616 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0363929 Jan 05 14:59:57.610470 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-cd4a7511-cf5d-42f5-924a-75ddd1b3a198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:57.611945 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-cd4a7511-cf5d-42f5-924a-75ddd1b3a198 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=715006ffd8ba4e5b963511ec759ae152&shared=False HTTP/1.1" status: 200 len: 911 time: 0.3640718 Jan 05 14:59:57.619986 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e req-44dc5279-b611-40f5-8f89-7265af3a198d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:57.620778 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e req-44dc5279-b611-40f5-8f89-7265af3a198d tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 943 time: 0.0897982 Jan 05 14:59:57.630449 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port a1de646c-827f-41ad-bab9-8457e33db96d, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a1de646c-827f-41ad-bab9-8457e33db96d,segment=NetworkSegment(9090f950-f416-4528-99a8-79f83e6339eb),segment_id=9090f950-f416-4528-99a8-79f83e6339eb)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:57.642954 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': 'a1de646c-827f-41ad-bab9-8457e33db96d', 'network_id': 'fca65618-396e-44a0-8e47-55fa90240fd2', 'port_id': 'a1de646c-827f-41ad-bab9-8457e33db96d', 'mac_address': 'fa:16:3e:d1:e6:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 102, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '851aa76f-ccc4-4997-b93f-8238639e6bfa', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 14:59:57.673664 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0cc3b848-eb4a-4b0b-950f-6abf1501b25e req-dafd01c6-b5b7-4660-ab62-d206eeac1ea8 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450687 Jan 05 14:59:57.683896 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:57.696996 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1de646c-827f-41ad-bab9-8457e33db96d {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 14:59:57.715906 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port a1de646c-827f-41ad-bab9-8457e33db96d, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a1de646c-827f-41ad-bab9-8457e33db96d,segment=NetworkSegment(9090f950-f416-4528-99a8-79f83e6339eb),segment_id=9090f950-f416-4528-99a8-79f83e6339eb)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 14:59:57.791303 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:57.842288 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954294a9-c44f-4eab-9358-afaf7e9042c2 req-3ed33091-3d3f-448a-a99f-525b00c54479 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:57.844568 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-954294a9-c44f-4eab-9358-afaf7e9042c2 req-3ed33091-3d3f-448a-a99f-525b00c54479 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0565479 Jan 05 14:59:57.858769 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=a1de646c-827f-41ad-bab9-8457e33db96d,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 14:59:57.899954 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-954294a9-c44f-4eab-9358-afaf7e9042c2 req-3f00e9a4-69b8-4548-82c8-76aafea68d87 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493188 Jan 05 14:59:58.180584 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f244623c-235e-46ab-8078-b72347875c28 req-9cff1b23-74ee-42d6-ab53-c29b110cebad tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:58.182048 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f244623c-235e-46ab-8078-b72347875c28 req-9cff1b23-74ee-42d6-ab53-c29b110cebad tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0506670 Jan 05 14:59:58.211141 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-92703fd4-ad2a-4122-be3c-2e3074b1c595 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 14:59:58.228756 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f244623c-235e-46ab-8078-b72347875c28 req-3010eaef-d022-4f2f-93d1-d42e49d3a3ff tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410020 Jan 05 14:59:58.685619 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73785481-e9aa-4caa-8b00-8aabe0c76d10 req-407ad177-e7df-46ba-b17c-5844c78f744e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0258579 Jan 05 14:59:58.747432 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-740b764b-062d-41d5-800a-224c0f7da14c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:58.748892 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dc9d52d6-d0e9-49e9-84fa-973efb522cc7 req-740b764b-062d-41d5-800a-224c0f7da14c service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1590877 Jan 05 14:59:58.795100 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93985268-489f-41bc-befa-dfc852e54bc3 req-2e4b56af-a4c2-45ec-b526-7d7203727537 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:58.796970 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93985268-489f-41bc-befa-dfc852e54bc3 req-2e4b56af-a4c2-45ec-b526-7d7203727537 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 944 time: 0.0465360 Jan 05 14:59:58.845851 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93985268-489f-41bc-befa-dfc852e54bc3 req-a1585fbe-54f5-49c0-bc85-8302584394af tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433671 Jan 05 14:59:59.012747 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff11dbcc-742c-4083-981a-39720600d7aa req-9c310037-d415-4fed-a616-39e10554f2ac tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:59.014243 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ff11dbcc-742c-4083-981a-39720600d7aa req-9c310037-d415-4fed-a616-39e10554f2ac tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0480442 Jan 05 14:59:59.063488 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ff11dbcc-742c-4083-981a-39720600d7aa req-31e450eb-5723-4964-880b-b971a2511fef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437818 Jan 05 14:59:59.345758 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2411fba3-31c0-4b26-9111-e2e710ccaeee req-2d230bec-11cd-40e9-bfcc-d4d5b5e0c920 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:59.347218 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2411fba3-31c0-4b26-9111-e2e710ccaeee req-2d230bec-11cd-40e9-bfcc-d4d5b5e0c920 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0511243 Jan 05 14:59:59.393754 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2411fba3-31c0-4b26-9111-e2e710ccaeee req-e8ab068b-915c-40c5-9157-d460bce74f70 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407424 Jan 05 14:59:59.781801 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b7f7a9bd-d541-4b6a-810a-017be393df4b req-67ce279d-1818-44c8-b8d9-a7640e918210 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0256307 Jan 05 14:59:59.959545 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb927abf-4b03-4965-89b8-c351ee816176 req-49f9e0b4-ba2d-4652-9767-a457f3d516f7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 14:59:59.961042 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb927abf-4b03-4965-89b8-c351ee816176 req-49f9e0b4-ba2d-4652-9767-a457f3d516f7 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 944 time: 0.0490596 Jan 05 15:00:00.008628 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb927abf-4b03-4965-89b8-c351ee816176 req-276d097a-b878-4e7c-b4ff-4d979809afcf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418646 Jan 05 15:00:00.175366 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 req-151db5eb-4c99-4b4b-b976-ed3520e98e45 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:00.176854 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 req-151db5eb-4c99-4b4b-b976-ed3520e98e45 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0489793 Jan 05 15:00:00.223586 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5d8360c8-21bf-4361-ac60-54437c9ddeb5 req-87d891b8-aa02-461f-a326-9e0da53b2bab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405557 Jan 05 15:00:00.405334 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09e0bdd7-4c1a-4360-a464-35768d13a906 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:00.432920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-bda810ba-eb7f-4638-af07-3eaf81c095ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:00.434420 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-bda810ba-eb7f-4638-af07-3eaf81c095ea service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 1096 time: 0.0438440 Jan 05 15:00:00.484535 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-26ef368b-b91e-4d6b-a8ae-9469b01469e7 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2886de19-8aa3-470c-a593-9381bdb36ca0 HTTP/1.1" status: 200 len: 217 time: 0.0350554 Jan 05 15:00:00.554673 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-eead2da5-dc09-4b71-8bd8-a4c497de1e38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:00.556098 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-eead2da5-dc09-4b71-8bd8-a4c497de1e38 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 200 len: 849 time: 0.0646336 Jan 05 15:00:00.566203 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8483c6-635a-4155-9cb3-a773123a07d9 req-6794581a-5663-40fc-a5e7-1857c176c24b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:00.567540 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4a8483c6-635a-4155-9cb3-a773123a07d9 req-6794581a-5663-40fc-a5e7-1857c176c24b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0860806 Jan 05 15:00:00.640223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-7c3e8f52-8bb9-4d4f-b127-f9776cee05a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:00.641730 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-7c3e8f52-8bb9-4d4f-b127-f9776cee05a8 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fb7bcda7-5039-4d82-bf68-12c9acc8a744&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0733755 Jan 05 15:00:00.650425 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4a8483c6-635a-4155-9cb3-a773123a07d9 req-3dc7e60c-5976-4246-afb9-72300d7d4295 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0740635 Jan 05 15:00:00.741930 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-017a0cd8-32a0-47e9-aa6b-d78ac716f3bd service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0901630 Jan 05 15:00:00.795760 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['a1de646c-827f-41ad-bab9-8457e33db96d'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:00:00.835726 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1358a905-461b-43f3-97fa-f5885ffdf9af req-12c0abb7-f02e-4d96-befa-21387a62e85a service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831325 Jan 05 15:00:00.880707 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-988fb539-bc7f-4948-8063-c2b2881c57d4 req-9bf27dc6-d514-45ea-8cc8-b3f771b5e43e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0278864 Jan 05 15:00:01.123810 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62da5366-1e13-4d78-8e94-673f11680fbe req-c99b1a17-cb02-47fc-a8e7-709e1233e388 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:01.125298 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-62da5366-1e13-4d78-8e94-673f11680fbe req-c99b1a17-cb02-47fc-a8e7-709e1233e388 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 944 time: 0.0481653 Jan 05 15:00:01.175407 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-62da5366-1e13-4d78-8e94-673f11680fbe req-bf44852e-dfa4-453c-8230-ca48cf09e2cb tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446837 Jan 05 15:00:01.340263 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 req-89447d17-5672-4b78-846b-afc77ae1ea09 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:01.341824 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 req-89447d17-5672-4b78-846b-afc77ae1ea09 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0535784 Jan 05 15:00:01.387400 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ef31b39f-fb09-47a2-8cdc-4ea159b70dd1 req-7c08d209-6829-47e7-b818-a08de831e7c1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395598 Jan 05 15:00:01.770187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 req-48eff893-7b44-4f18-b9c0-2859b236fcc0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:01.771944 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 req-48eff893-7b44-4f18-b9c0-2859b236fcc0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0483532 Jan 05 15:00:01.790577 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:01.818075 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2f091c4e-2ba9-4fb8-8fa4-1643d02260b0 req-32d8831d-e126-462c-86b1-bf5d24785ba4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405684 Jan 05 15:00:01.983958 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f67d0f2e-2101-4ba6-bbf8-35ec17d78851 req-82aef7a3-10ec-472d-baf1-00dd9c2d511d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0254307 Jan 05 15:00:02.285024 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fba8c8f-1af2-4682-91b7-6860bd947011 req-e15995ee-ce84-4b8e-a335-d5afc0fe9441 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:02.286542 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8fba8c8f-1af2-4682-91b7-6860bd947011 req-e15995ee-ce84-4b8e-a335-d5afc0fe9441 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 944 time: 0.0471728 Jan 05 15:00:02.332738 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8fba8c8f-1af2-4682-91b7-6860bd947011 req-bbac0bfe-a957-45ca-a8d5-e723c26c5b9e tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397928 Jan 05 15:00:02.497220 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d311d5fb-a746-4a28-b9a8-47e678b6eecb req-c29652e9-d9f3-4c92-a373-d1cb63ff0d89 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:02.498725 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d311d5fb-a746-4a28-b9a8-47e678b6eecb req-c29652e9-d9f3-4c92-a373-d1cb63ff0d89 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0474486 Jan 05 15:00:02.544339 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d311d5fb-a746-4a28-b9a8-47e678b6eecb req-b16492f6-06c7-4bdd-84f2-6808e36d4ff1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393548 Jan 05 15:00:02.767660 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:02.931844 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 req-71a82e17-0fa1-4d87-9319-b1ccb29697a4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:02.933246 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 req-71a82e17-0fa1-4d87-9319-b1ccb29697a4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0499969 Jan 05 15:00:02.979354 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a1bebf94-1ac4-49f2-9b9b-f193c5b0c606 req-96f6ff15-635f-4ef5-89d6-9b81b6b7c8ec tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405028 Jan 05 15:00:03.080799 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0983a639-2357-40ee-95ca-bd7d602e15d5 req-971185ba-d140-4b62-8c59-01cf742e80cd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0277407 Jan 05 15:00:03.393836 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['7e97ea9f-9968-4d12-a26d-c48d64741cea'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:00:03.446529 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dae5048-041c-4bf8-a611-d27a154c7fe0 req-367e4fc1-d551-476d-a5cf-596ada8195a2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:03.447962 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5dae5048-041c-4bf8-a611-d27a154c7fe0 req-367e4fc1-d551-476d-a5cf-596ada8195a2 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 944 time: 0.0501487 Jan 05 15:00:03.527773 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:03.551500 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5dae5048-041c-4bf8-a611-d27a154c7fe0 req-b9a3e1f1-dcda-41b6-8dd9-9d282fb17744 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911586 Jan 05 15:00:03.595041 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-88d8ac11-61ca-492e-a6f1-23426057a9b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:03.595041 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-88d8ac11-61ca-492e-a6f1-23426057a9b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 817 time: 0.1371047 Jan 05 15:00:03.658593 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-43c3ebfb-fbe9-4438-b70e-68e3ef992211 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 380 time: 0.0536835 Jan 05 15:00:03.662450 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 req-6dd20ceb-2a57-4fd4-a73f-f4d6b276e736 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:03.663895 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 req-6dd20ceb-2a57-4fd4-a73f-f4d6b276e736 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0485337 Jan 05 15:00:03.668133 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'port': {'device_id': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'admin_state_up': True, 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'security_groups': ['f3335da6-9782-4236-8228-e5257a8ab1ba']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:03.709722 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-029ad1a6-87f7-4b2d-82eb-3399fcb4f5f7 req-ceb08dca-3de0-41cd-9ac7-c18a376214b7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399106 Jan 05 15:00:03.850754 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Made reservation on behalf of f4a45a70c5d046238abaad07fbe529e9 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:00:03.855939 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:03.962363 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:00:03.986784 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Allocated IP 172.20.0.14 (1c375b41-1339-4d14-93e7-e473aa7e6978/afd427f5-19eb-439b-9825-d3ec4a285d49/45483c3c-9f42-4aff-a962-22ff36647afc) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:00:04.146048 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 req-a0380020-ab22-4fbd-aff4-82b1ae2f6c65 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:04.147521 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 req-a0380020-ab22-4fbd-aff4-82b1ae2f6c65 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0794122 Jan 05 15:00:04.160993 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:04.178140 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a1e54213-b8f2-4c1c-a670-ed344a8945af req-aa0ce297-d039-49fb-8d77-a401a7a63cd6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0260057 Jan 05 15:00:04.221687 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d55d01a3-56dd-4a80-86d5-d4afc9bf4099 req-209b9722-cea1-49c2-b06d-fdd6b6f98e70 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0574174 Jan 05 15:00:04.343736 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:04.387514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:00:04.390548 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:00:04.394363 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:00:04.400049 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:04.400668 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:04.416251 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:04.440523 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:04.606310 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-a7e4e48b-afae-47f6-ba1c-c50c92f4a4cc None None] Provisioning complete for port 45483c3c-9f42-4aff-a962-22ff36647afc triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:00:04.611143 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a7e4e48b-afae-47f6-ba1c-c50c92f4a4cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:04.641129 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-a7e4e48b-afae-47f6-ba1c-c50c92f4a4cc None None] Port 45483c3c-9f42-4aff-a962-22ff36647afc cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:00:04.665371 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 req-1f1998cb-e065-4a75-bd6b-449e27d19068 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:04.666828 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 req-1f1998cb-e065-4a75-bd6b-449e27d19068 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 944 time: 0.0471380 Jan 05 15:00:04.716012 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8875b2a9-b3f7-49b8-b9d5-f4d934a62c50 req-a08f3444-dbe8-41db-9231-4d8889eb3c98 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434906 Jan 05 15:00:04.817598 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7169633d-2632-488c-9b86-295e2b6936da tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1529527 Jan 05 15:00:04.830619 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f071b81e-e853-4e89-bf28-c56d89078c15 req-0bce8af4-e8eb-4650-ae8d-af3c8635cc11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:04.832104 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f071b81e-e853-4e89-bf28-c56d89078c15 req-0bce8af4-e8eb-4650-ae8d-af3c8635cc11 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0541236 Jan 05 15:00:04.837320 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Request body: {'port': {'device_id': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:04.923922 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:04.928968 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f071b81e-e853-4e89-bf28-c56d89078c15 req-227ca82e-68cf-4013-9bf6-3876290ed88d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888236 Jan 05 15:00:05.295341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 45483c3c-9f42-4aff-a962-22ff36647afc {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:00:05.304803 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.317627 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42234) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:05.327814 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Transition to ACTIVE for port object 45483c3c-9f42-4aff-a962-22ff36647afc will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:00:05.343818 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab55c72-fd43-482a-89e5-01e32e00a15a req-da7f9ef2-31ff-45dc-9ba2-ba0ecaf11ed9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:05.350530 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7ab55c72-fd43-482a-89e5-01e32e00a15a req-da7f9ef2-31ff-45dc-9ba2-ba0ecaf11ed9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 932 time: 0.0677800 Jan 05 15:00:05.395512 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f181e-9177-4b5b-bd69-1d4b982e542c req-0dc8f4c8-b34b-4089-bbdc-b1187cbdfa8e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:05.402085 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f181e-9177-4b5b-bd69-1d4b982e542c req-0dc8f4c8-b34b-4089-bbdc-b1187cbdfa8e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 943 time: 0.0680904 Jan 05 15:00:05.409100 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 2886de19-8aa3-470c-a593-9381bdb36ca0 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:00:05.411138 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7ab55c72-fd43-482a-89e5-01e32e00a15a req-c64b5744-d94a-4b81-975b-d21d468b2fa2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596814 Jan 05 15:00:05.420779 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 7e97ea9f-9968-4d12-a26d-c48d64741cea up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:00:05.453349 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.516629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-184d3ede-f15b-4620-9871-c24b7617660a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.573169 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:05.589702 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f181e-9177-4b5b-bd69-1d4b982e542c req-e2731cc7-58df-4425-b7aa-4ccb7084f8df tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1866398 Jan 05 15:00:05.614896 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 2886de19-8aa3-470c-a593-9381bdb36ca0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2886de19-8aa3-470c-a593-9381bdb36ca0,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:05.627142 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 7e97ea9f-9968-4d12-a26d-c48d64741cea completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:00:05.632976 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 7e97ea9f-9968-4d12-a26d-c48d64741cea triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:00:05.633582 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.636839 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'port_id': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'mac_address': 'fa:16:3e:90:e0:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:00:05.649506 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Attempting to bind port 45483c3c-9f42-4aff-a962-22ff36647afc on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:00:05.649848 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Attempting to bind port 45483c3c-9f42-4aff-a962-22ff36647afc by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:00:05.650174 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Attempting to bind port 45483c3c-9f42-4aff-a962-22ff36647afc on network 1c375b41-1339-4d14-93e7-e473aa7e6978 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:00:05.681355 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Port 45483c3c-9f42-4aff-a962-22ff36647afc on network 1c375b41-1339-4d14-93e7-e473aa7e6978 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:00:05.681873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Attempting to bind port 45483c3c-9f42-4aff-a962-22ff36647afc on network 1c375b41-1339-4d14-93e7-e473aa7e6978 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:00:05.693315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 0, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:00:05.694219 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Checking segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:00:05.694638 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Bound using segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:00:05.695198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Bound port: 45483c3c-9f42-4aff-a962-22ff36647afc, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:00:05.695581 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.697611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.715921 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2886de19-8aa3-470c-a593-9381bdb36ca0 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:00:05.741515 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 2886de19-8aa3-470c-a593-9381bdb36ca0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2886de19-8aa3-470c-a593-9381bdb36ca0,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:05.744794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-184d3ede-f15b-4620-9871-c24b7617660a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.811356 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:00:05.815166 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:00:05.850726 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da80caa-815a-41b1-9ae2-5905a2725827 req-ba399853-cae8-4fa0-b516-f892cd8c7904 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:05.858512 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2da80caa-815a-41b1-9ae2-5905a2725827 req-ba399853-cae8-4fa0-b516-f892cd8c7904 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 944 time: 0.0599701 Jan 05 15:00:05.871018 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-184d3ede-f15b-4620-9871-c24b7617660a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.903685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.903903 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2da80caa-815a-41b1-9ae2-5905a2725827 req-3c8c0b9c-d80a-4885-9b20-5341c54baecf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437727 Jan 05 15:00:05.904571 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:05.905987 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 94077c14-de44-48f3-8ca4-3b1be238b708 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:00:05.963764 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.040071 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=2886de19-8aa3-470c-a593-9381bdb36ca0,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:06.061573 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e97ea9f-9968-4d12-a26d-c48d64741cea'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:06.122336 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-184d3ede-f15b-4620-9871-c24b7617660a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=00ecba1e2bf3435392069e0cfa8522f4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8036449 Jan 05 15:00:06.125081 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42262) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:06.127083 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-184d3ede-f15b-4620-9871-c24b7617660a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8cb806b4-d108-4166-bf4b-5eb134a73664,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:06.217198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.217198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.217198 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] 10.222.0.13 "PUT /v2.0/ports/45483c3c-9f42-4aff-a962-22ff36647afc HTTP/1.1" status: 200 len: 1094 time: 1.3293679 Jan 05 15:00:06.217198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:06.217198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22" -d '{"events": [{"name": "network-changed", "server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:06.217198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9aef9e0-1db4-4257-83f7-2a83e442655e service neutron] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:06.217198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8674127d-c377-4e2f-b0ae-c28448b28b10 req-74e6e2fe-3a3d-4ee6-8dd0-2e03a998e99a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.219140 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 94077c14-de44-48f3-8ca4-3b1be238b708, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=94077c14-de44-48f3-8ca4-3b1be238b708,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:06.219219 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8674127d-c377-4e2f-b0ae-c28448b28b10 req-74e6e2fe-3a3d-4ee6-8dd0-2e03a998e99a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 944 time: 0.0929081 Jan 05 15:00:06.232489 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6d7db406-124e-452c-8dd3-c5db0106a8a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.234357 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '94077c14-de44-48f3-8ca4-3b1be238b708', 'network_id': '975fa447-11a2-47cd-86bf-82619c2a8abd', 'port_id': '94077c14-de44-48f3-8ca4-3b1be238b708', 'mac_address': 'fa:16:3e:20:8d:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '05f78cb6-38bd-4a95-a1d0-4c4654bbd075', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:00:06.251679 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 7e97ea9f-9968-4d12-a26d-c48d64741cea, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:06.251779 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-39aedaab-c24c-4c5a-b3b7-b5440483a713 x-openstack-request-id: req-39aedaab-c24c-4c5a-b3b7-b5440483a713 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:06.251779 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:06.251779 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-39aedaab-c24c-4c5a-b3b7-b5440483a713 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:06.251779 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc', 'status': 'completed', 'code': 200} Jan 05 15:00:06.293907 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6d7db406-124e-452c-8dd3-c5db0106a8a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.300510 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8674127d-c377-4e2f-b0ae-c28448b28b10 req-20055def-f9a7-4018-b942-36b39744a888 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806701 Jan 05 15:00:06.302514 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.332557 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 94077c14-de44-48f3-8ca4-3b1be238b708 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:00:06.371250 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 94077c14-de44-48f3-8ca4-3b1be238b708, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=94077c14-de44-48f3-8ca4-3b1be238b708,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:06.374254 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-a1f8a055-2631-49d1-b138-111bcb679213 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.374423 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.375169 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a1de646c-827f-41ad-bab9-8457e33db96d up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:00:06.376080 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-a1f8a055-2631-49d1-b138-111bcb679213 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1097 time: 0.0742652 Jan 05 15:00:06.417053 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd4e436e-5fcb-4790-8ce4-934eed04d64f" -d '{"events": [{"server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "name": "network-vif-plugged", "status": "completed", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:06.465418 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6d7db406-124e-452c-8dd3-c5db0106a8a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.468182 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6d7db406-124e-452c-8dd3-c5db0106a8a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.472737 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-6d7db406-124e-452c-8dd3-c5db0106a8a1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8cb806b4-d108-4166-bf4b-5eb134a73664 HTTP/1.1" status: 204 len: 168 time: 0.3427725 Jan 05 15:00:06.479010 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7db406-124e-452c-8dd3-c5db0106a8a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8cb806b4-d108-4166-bf4b-5eb134a73664,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:06.526110 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.572992 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-a726ed85-7ae4-4f70-9e1e-f69050b91558 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.572992 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-a726ed85-7ae4-4f70-9e1e-f69050b91558 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=f4a45a70c5d046238abaad07fbe529e9&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1575961 Jan 05 15:00:06.574066 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=7e97ea9f-9968-4d12-a26d-c48d64741cea,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:06.601756 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 x-openstack-request-id: req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:06.602064 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "name": "network-vif-plugged", "status": "completed", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:06.602326 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e51bf56e-6f96-4c3b-9588-319b17f8a7d3 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:06.602778 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e97ea9f-9968-4d12-a26d-c48d64741cea', 'code': 200} Jan 05 15:00:06.607583 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=94077c14-de44-48f3-8ca4-3b1be238b708,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:06.663425 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port a1de646c-827f-41ad-bab9-8457e33db96d completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:00:06.668901 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port a1de646c-827f-41ad-bab9-8457e33db96d triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:00:06.675673 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.685540 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 req-6585fa8c-e3cf-4bef-89f7-1e7713ed1eb0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.687725 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 req-6585fa8c-e3cf-4bef-89f7-1e7713ed1eb0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.1373446 Jan 05 15:00:06.730643 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-7f57f8ba-db6d-4d7e-b4d3-0ab0a54186c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.732316 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e88f6e8f-fb47-49f1-a289-f6ac15bd0d22 req-7f57f8ba-db6d-4d7e-b4d3-0ab0a54186c7 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1633878 Jan 05 15:00:06.747584 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 req-40b12723-278f-48ac-bab8-e8da6d390a7e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.749865 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 req-40b12723-278f-48ac-bab8-e8da6d390a7e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 944 time: 0.0783527 Jan 05 15:00:06.756358 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0cfbd485-bc90-4f16-81d8-fc65c4da36f1 req-661da683-25fc-4a26-992d-47d885331cc6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0615201 Jan 05 15:00:06.784554 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:06.809105 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1ef43702-b270-4b87-a951-5fbbcc2ab6e9 req-c9cfb212-be35-4689-9d4f-e45a12932af2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536032 Jan 05 15:00:06.820303 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port a1de646c-827f-41ad-bab9-8457e33db96d, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a1de646c-827f-41ad-bab9-8457e33db96d,segment=NetworkSegment(9090f950-f416-4528-99a8-79f83e6339eb),segment_id=9090f950-f416-4528-99a8-79f83e6339eb)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:06.844277 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9055135-a5e6-4a0e-bedc-68e68ea16302 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.845805 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-b9055135-a5e6-4a0e-bedc-68e68ea16302 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1097 time: 0.0398219 Jan 05 15:00:06.898417 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['2886de19-8aa3-470c-a593-9381bdb36ca0'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:00:06.898706 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-32975fdc-5a2b-4a19-9505-1cfbdffe4ea8 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=45483c3c-9f42-4aff-a962-22ff36647afc HTTP/1.1" status: 200 len: 217 time: 0.0372777 Jan 05 15:00:06.926642 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['94077c14-de44-48f3-8ca4-3b1be238b708'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:00:06.950010 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-3e74d485-6707-40e0-9619-4582b4304061 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:06.951524 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-3e74d485-6707-40e0-9619-4582b4304061 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0463386 Jan 05 15:00:07.010642 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-1f2a45a3-f713-46c3-8b35-22a7eb1e2c87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:07.013033 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-1f2a45a3-f713-46c3-8b35-22a7eb1e2c87 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0547738 Jan 05 15:00:07.029892 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.125004 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d475d064-975d-473f-8ab5-beff8cd105b3 req-03a584d7-b6d9-407f-b617-59fdf0aa947a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:07.126540 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d475d064-975d-473f-8ab5-beff8cd105b3 req-03a584d7-b6d9-407f-b617-59fdf0aa947a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.1084826 Jan 05 15:00:07.144486 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=a1de646c-827f-41ad-bab9-8457e33db96d,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:07.170638 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-2bcce437-afbc-4ad3-9799-2655ec11742e service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1439114 Jan 05 15:00:07.251510 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d475d064-975d-473f-8ab5-beff8cd105b3 req-94d933d0-0a1e-43db-91e6-de9529933214 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163607 Jan 05 15:00:07.293497 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5ce132e-5901-4f86-8bac-ea628ed1b598 req-7408fe2d-9eff-4bc0-a0c2-c8de6f31f4d3 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1137917 Jan 05 15:00:07.298274 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b677a88-24f8-4f46-8e13-d194efa4fa1b req-aebd949f-5e1d-49e0-b02e-8583f22ca281 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:07.303463 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3b677a88-24f8-4f46-8e13-d194efa4fa1b req-aebd949f-5e1d-49e0-b02e-8583f22ca281 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.0793393 Jan 05 15:00:07.322801 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-3b677a88-24f8-4f46-8e13-d194efa4fa1b req-e0c43645-74fc-4a7d-b492-2b4efd1e6c8f service neutron] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.429492 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-3b677a88-24f8-4f46-8e13-d194efa4fa1b req-e0c43645-74fc-4a7d-b492-2b4efd1e6c8f service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.445270 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad3390b-f47b-4d33-a8cc-1e6e74639dec req-e2171070-4c85-4ca9-8111-3a4881f693f6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:07.446854 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cad3390b-f47b-4d33-a8cc-1e6e74639dec req-e2171070-4c85-4ca9-8111-3a4881f693f6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 945 time: 0.0677748 Jan 05 15:00:07.464687 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42302) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:07.480311 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e0db582e-387a-4ff6-926c-08b7c2c5dd23 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.496070 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cad3390b-f47b-4d33-a8cc-1e6e74639dec req-329e082a-77aa-40bf-b7c1-b932b3d266fd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438290 Jan 05 15:00:07.525378 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-3b677a88-24f8-4f46-8e13-d194efa4fa1b req-e0c43645-74fc-4a7d-b492-2b4efd1e6c8f service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.560647 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e0db582e-387a-4ff6-926c-08b7c2c5dd23 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.572659 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3b677a88-24f8-4f46-8e13-d194efa4fa1b req-e0c43645-74fc-4a7d-b492-2b4efd1e6c8f service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2626801 Jan 05 15:00:07.573644 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c43645-74fc-4a7d-b492-2b4efd1e6c8f service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=03a6eaac-4a14-43f6-93ac-73514056fbb9,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:07.639606 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e0db582e-387a-4ff6-926c-08b7c2c5dd23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.677569 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-e0db582e-387a-4ff6-926c-08b7c2c5dd23 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1eb42812b9514b96863176c67d04da7d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2113817 Jan 05 15:00:07.679910 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0db582e-387a-4ff6-926c-08b7c2c5dd23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6561541d-4464-4b7b-84e8-84a99d18d388,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:07.681369 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42308) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:07.732054 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a63368a5-12b1-49c6-8e6b-8679eb6afc24 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.752709 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a63368a5-12b1-49c6-8e6b-8679eb6afc24 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.879673 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d req-00a3e4a0-a0d6-4ffc-be75-d189d32f3f44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:07.881244 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d req-00a3e4a0-a0d6-4ffc-be75-d189d32f3f44 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0527966 Jan 05 15:00:07.908570 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a63368a5-12b1-49c6-8e6b-8679eb6afc24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.911228 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a63368a5-12b1-49c6-8e6b-8679eb6afc24 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:07.912382 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a63368a5-12b1-49c6-8e6b-8679eb6afc24 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6561541d-4464-4b7b-84e8-84a99d18d388 HTTP/1.1" status: 204 len: 168 time: 0.2300122 Jan 05 15:00:07.920974 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a63368a5-12b1-49c6-8e6b-8679eb6afc24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6561541d-4464-4b7b-84e8-84a99d18d388,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:07.948566 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 req-df43af7a-ab8a-43bf-84e3-e88369bb6a9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:07.950156 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 req-df43af7a-ab8a-43bf-84e3-e88369bb6a9e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 944 time: 0.0714407 Jan 05 15:00:07.953790 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e31d5198-b121-4bb0-9e99-2ac8bf8bfd6d req-03289571-5196-49a7-8548-5290d5284a8e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0668859 Jan 05 15:00:08.005433 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49ab7431-f96d-4171-aa0c-873bef7bb7b8 req-5dd2b31a-79fc-4ea2-b8a3-568bb651f798 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451865 Jan 05 15:00:08.368496 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b6ab9d-b807-43c2-bcab-7cdec91148cf req-37791748-234c-4745-a7f0-da2a654398c3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:08.373539 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-02b6ab9d-b807-43c2-bcab-7cdec91148cf req-37791748-234c-4745-a7f0-da2a654398c3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0551047 Jan 05 15:00:08.422427 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-02b6ab9d-b807-43c2-bcab-7cdec91148cf req-6c2e88c6-f1f5-419b-93a9-24a7f9346b1f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468781 Jan 05 15:00:08.604062 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6cf86612-a721-4032-9b56-b9828fc658cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1de646c-827f-41ad-bab9-8457e33db96d'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:08.606663 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91f009f6-d8ff-4089-ba31-1a7c8934803c" -d '{"events": [{"server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "name": "network-vif-plugged", "status": "completed", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:08.615092 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd req-298428f1-ab24-4341-a6ff-387f6cb4642c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:08.616608 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd req-298428f1-ab24-4341-a6ff-387f6cb4642c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 945 time: 0.0508091 Jan 05 15:00:08.643295 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0feab5c9-3e0f-416e-8e78-47910d27d256 x-openstack-request-id: req-0feab5c9-3e0f-416e-8e78-47910d27d256 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:08.643586 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "name": "network-vif-plugged", "status": "completed", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:08.643839 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0feab5c9-3e0f-416e-8e78-47910d27d256 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:08.644259 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6cf86612-a721-4032-9b56-b9828fc658cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1de646c-827f-41ad-bab9-8457e33db96d', 'code': 200} Jan 05 15:00:08.664210 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-dec717f3-c0ec-47c0-b3ff-c47c8fa779dd req-ad54949a-da38-4cbf-8639-b6aa26f6b763 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421541 Jan 05 15:00:09.074299 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 req-212a5cf1-b07f-4ca9-b3b9-35a8820fa633 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:09.076075 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 req-212a5cf1-b07f-4ca9-b3b9-35a8820fa633 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0490384 Jan 05 15:00:09.126460 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5824cbfc-878b-47fc-b771-7ea376dc5a82 req-72c64ef0-5b5e-4a46-9ed3-362313f3ff32 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:09.128354 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5824cbfc-878b-47fc-b771-7ea376dc5a82 req-72c64ef0-5b5e-4a46-9ed3-362313f3ff32 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 944 time: 0.0544159 Jan 05 15:00:09.131114 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3e0b1c1b-9c49-466c-af5d-3b4b9293e621 req-5bea2d27-8252-49e7-b108-10af74b4d6bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488648 Jan 05 15:00:09.201555 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e2b987d-2ca7-41df-a29f-e3102d13025f req-e262282a-1f58-4025-87f7-652a109d90f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:09.203614 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1e2b987d-2ca7-41df-a29f-e3102d13025f req-e262282a-1f58-4025-87f7-652a109d90f3 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 1098 time: 0.0743911 Jan 05 15:00:09.207479 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5824cbfc-878b-47fc-b771-7ea376dc5a82 req-2857c432-fb78-4726-b3c9-5db07d357ea8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0686095 Jan 05 15:00:09.253686 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1e2b987d-2ca7-41df-a29f-e3102d13025f req-6aa1bfc4-0c29-42b7-b44f-2007196f6afa service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428343 Jan 05 15:00:09.430426 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:00:09.443524 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 2886de19-8aa3-470c-a593-9381bdb36ca0 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:00:09.579206 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 req-aa973c4d-9acc-4c95-b0d2-9af2cce9d10a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:09.588100 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 req-aa973c4d-9acc-4c95-b0d2-9af2cce9d10a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0855913 Jan 05 15:00:09.610519 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:09.636253 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 2886de19-8aa3-470c-a593-9381bdb36ca0 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:00:09.641303 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '45483c3c-9f42-4aff-a962-22ff36647afc', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'port_id': '45483c3c-9f42-4aff-a962-22ff36647afc', 'mac_address': 'fa:16:3e:25:44:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:00:09.644373 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 2886de19-8aa3-470c-a593-9381bdb36ca0 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:00:09.644755 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:09.650380 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1aa6e9f5-12ab-485b-9e04-d1684cc94d95 req-3982867f-7eda-4081-b1f7-17e0e9912625 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611904 Jan 05 15:00:09.650913 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42392) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:09.735449 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:09.755096 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 45483c3c-9f42-4aff-a962-22ff36647afc {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:00:09.786107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4cafaec8-ded2-4b6c-ac13-dd599f1e9c29 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:09.799297 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:09.806474 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16d2ff21-5632-4403-97ae-e8533b52ec80 req-a409e212-e409-4062-a2c4-0276dae93b1f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:09.808101 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:09.813660 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-16d2ff21-5632-4403-97ae-e8533b52ec80 req-a409e212-e409-4062-a2c4-0276dae93b1f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 945 time: 0.0716479 Jan 05 15:00:09.847134 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 2886de19-8aa3-470c-a593-9381bdb36ca0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2886de19-8aa3-470c-a593-9381bdb36ca0,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:09.868898 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-16d2ff21-5632-4403-97ae-e8533b52ec80 req-f3dd36d6-ac80-4014-b607-68b48be3e332 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510459 Jan 05 15:00:09.890460 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4cafaec8-ded2-4b6c-ac13-dd599f1e9c29 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:09.932021 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:09.983310 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:09.986001 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:09.986694 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 94077c14-de44-48f3-8ca4-3b1be238b708 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:00:10.028615 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4cafaec8-ded2-4b6c-ac13-dd599f1e9c29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.065154 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=2886de19-8aa3-470c-a593-9381bdb36ca0,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:10.068785 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-4cafaec8-ded2-4b6c-ac13-dd599f1e9c29 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1af8f554c27c4082857972f93ac139a2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4167988 Jan 05 15:00:10.069901 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cafaec8-ded2-4b6c-ac13-dd599f1e9c29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=761d8a85-172b-41fa-9c93-6e38ce103afe,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:10.071581 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42402) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:10.119529 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bff1acd0-b37d-40a8-aac1-e37643a769e6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.140696 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bff1acd0-b37d-40a8-aac1-e37643a769e6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.180702 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 94077c14-de44-48f3-8ca4-3b1be238b708 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:00:10.184815 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 94077c14-de44-48f3-8ca4-3b1be238b708 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:00:10.185402 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.274873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b4baf9-f975-4d17-ae62-1e1eeb72801e req-11643455-cde9-4821-bd0a-013cfefb009b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:10.281809 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-35b4baf9-f975-4d17-ae62-1e1eeb72801e req-11643455-cde9-4821-bd0a-013cfefb009b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 945 time: 0.0649836 Jan 05 15:00:10.282266 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.310445 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bff1acd0-b37d-40a8-aac1-e37643a769e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.313580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bff1acd0-b37d-40a8-aac1-e37643a769e6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.317215 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-bff1acd0-b37d-40a8-aac1-e37643a769e6 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/761d8a85-172b-41fa-9c93-6e38ce103afe HTTP/1.1" status: 204 len: 168 time: 0.2420089 Jan 05 15:00:10.317417 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 94077c14-de44-48f3-8ca4-3b1be238b708, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=94077c14-de44-48f3-8ca4-3b1be238b708,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:10.329203 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff1acd0-b37d-40a8-aac1-e37643a769e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=761d8a85-172b-41fa-9c93-6e38ce103afe,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:10.362704 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-35b4baf9-f975-4d17-ae62-1e1eeb72801e req-d2d475c7-3305-4171-8b90-878f3722d5b2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0759487 Jan 05 15:00:10.366709 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc69e48f-b373-4547-a18a-4cce8eaced16 req-5b9f271a-3741-4dfa-ad15-de61c65702fe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:10.383200 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-dc69e48f-b373-4547-a18a-4cce8eaced16 req-5b9f271a-3741-4dfa-ad15-de61c65702fe tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0908096 Jan 05 15:00:10.383612 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['45483c3c-9f42-4aff-a962-22ff36647afc'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:00:10.441010 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:10.453590 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-dc69e48f-b373-4547-a18a-4cce8eaced16 req-b77d5481-5510-4717-b650-217a8b23ec1e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0790527 Jan 05 15:00:10.514143 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=94077c14-de44-48f3-8ca4-3b1be238b708,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:10.645364 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0'}, {'server_uuid': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94077c14-de44-48f3-8ca4-3b1be238b708'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:10.647780 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64e9cccb-b8a2-482c-9c96-2b9176d2a34b" -d '{"events": [{"server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "name": "network-vif-plugged", "status": "completed", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}, {"server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "name": "network-vif-plugged", "status": "completed", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:10.714496 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4cf5aca6-d1f6-44ed-99c7-239490bba533 x-openstack-request-id: req-4cf5aca6-d1f6-44ed-99c7-239490bba533 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:10.714496 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "name": "network-vif-plugged", "status": "completed", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0", "code": 200}, {"server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "name": "network-vif-plugged", "status": "completed", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:10.714496 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4cf5aca6-d1f6-44ed-99c7-239490bba533 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:10.714496 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'code': 200} Jan 05 15:00:10.714496 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '94077c14-de44-48f3-8ca4-3b1be238b708', 'code': 200} Jan 05 15:00:10.772439 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 req-aa12dbb7-ec78-432a-bc61-d457150ba422 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:10.773932 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 req-aa12dbb7-ec78-432a-bc61-d457150ba422 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0480227 Jan 05 15:00:10.828301 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cda39dd6-5d83-43ff-80d0-7751aa967ba9 req-b7bd175f-9998-4371-b5d7-289a928f4059 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488536 Jan 05 15:00:10.986252 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 req-525e99fa-9da6-4345-a72c-df355e834e23 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:10.987768 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 req-525e99fa-9da6-4345-a72c-df355e834e23 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0520413 Jan 05 15:00:11.036995 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4ccfaa0b-4389-46cd-80fb-1697bfa32ff8 req-c1cebb57-2093-4130-90e9-7be57caa9fd6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433104 Jan 05 15:00:11.260548 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea02ce6-9a82-4fdc-a688-ae1075af0267 req-e239a866-d16b-48d0-abdf-a7ae93eaa6b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:11.262285 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6ea02ce6-9a82-4fdc-a688-ae1075af0267 req-e239a866-d16b-48d0-abdf-a7ae93eaa6b3 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 1099 time: 0.0488367 Jan 05 15:00:11.263227 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42436) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:11.284322 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f686c350-60d2-4192-baec-254d3692e022 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.338674 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6ea02ce6-9a82-4fdc-a688-ae1075af0267 req-7d446c36-dd36-4bb7-b0b7-04a9284bbe84 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676739 Jan 05 15:00:11.364261 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b60ccb5-4140-4aea-9598-fd67aac04534 req-137966bc-7faa-4ccb-8772-6e927b5e30de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:11.366811 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9b60ccb5-4140-4aea-9598-fd67aac04534 req-137966bc-7faa-4ccb-8772-6e927b5e30de service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 1098 time: 0.0861282 Jan 05 15:00:11.397485 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f686c350-60d2-4192-baec-254d3692e022 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.452458 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:00:11.482303 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b4325a-e408-4dac-8809-9713f438f962 req-15ec2405-b52c-4993-8163-55e279d4cbb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:11.484639 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c9b4325a-e408-4dac-8809-9713f438f962 req-15ec2405-b52c-4993-8163-55e279d4cbb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 945 time: 0.0530572 Jan 05 15:00:11.485959 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f686c350-60d2-4192-baec-254d3692e022 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.554010 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f686c350-60d2-4192-baec-254d3692e022 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d07b1035-0785-45b5-9db7-e32f06a8d1fa,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:11.576093 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f686c350-60d2-4192-baec-254d3692e022 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bc90c0e1fa3f411e98c6f008e5d5285a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3118970 Jan 05 15:00:11.580330 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42450) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:11.591150 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c9b4325a-e408-4dac-8809-9713f438f962 req-051ba589-6869-410f-830b-adf5f2449775 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0943439 Jan 05 15:00:11.596740 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 45483c3c-9f42-4aff-a962-22ff36647afc completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:00:11.601753 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 45483c3c-9f42-4aff-a962-22ff36647afc triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:00:11.606007 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.638826 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 req-db09cf07-7927-4e26-979c-5b2ed22c37cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:11.641003 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 req-db09cf07-7927-4e26-979c-5b2ed22c37cd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0882123 Jan 05 15:00:11.679227 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cad24f16-2811-45a9-a7fc-47e3d2251bcc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.713582 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cad24f16-2811-45a9-a7fc-47e3d2251bcc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.745378 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-79358c0e-db9c-473c-8fb9-d82fdfa2d894 req-bb1fdda5-5ed8-4f50-abe0-c669274614c6 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0967319 Jan 05 15:00:11.746492 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.749981 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9b60ccb5-4140-4aea-9598-fd67aac04534 req-93e61792-defa-4419-be1c-b59302272eeb service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1325986 Jan 05 15:00:11.785899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:11.906207 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.906492 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cad24f16-2811-45a9-a7fc-47e3d2251bcc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.911150 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cad24f16-2811-45a9-a7fc-47e3d2251bcc admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:11.912913 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-cad24f16-2811-45a9-a7fc-47e3d2251bcc admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d07b1035-0785-45b5-9db7-e32f06a8d1fa HTTP/1.1" status: 204 len: 168 time: 0.3307045 Jan 05 15:00:11.936423 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad24f16-2811-45a9-a7fc-47e3d2251bcc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d07b1035-0785-45b5-9db7-e32f06a8d1fa,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:11.949812 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42466) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:11.999442 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:12.061289 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ebdad27-9d5c-472a-b91a-7801ce9dcc08 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:12.166211 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ebdad27-9d5c-472a-b91a-7801ce9dcc08 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:12.181593 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8d88a6-f247-4bbe-bf98-efc519e59041 req-a8c6cda8-180c-43c6-945a-a85d83c1e294 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:12.182922 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7e8d88a6-f247-4bbe-bf98-efc519e59041 req-a8c6cda8-180c-43c6-945a-a85d83c1e294 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0781121 Jan 05 15:00:12.233004 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7e8d88a6-f247-4bbe-bf98-efc519e59041 req-92e74eae-0f0a-4589-85b3-89e46a918ed1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445385 Jan 05 15:00:12.321933 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ebdad27-9d5c-472a-b91a-7801ce9dcc08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:12.361517 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ebdad27-9d5c-472a-b91a-7801ce9dcc08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b76dd4d-8a1f-42b0-aea0-ecba3626c942,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:12.368492 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4ebdad27-9d5c-472a-b91a-7801ce9dcc08 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ecf16855511c4ec8a6d102b40f2f1d74&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4140007 Jan 05 15:00:12.368624 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42480) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:12.420509 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40144a36-5c78-4604-8293-b5b9a739c17d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:12.441829 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40144a36-5c78-4604-8293-b5b9a739c17d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:12.556933 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40144a36-5c78-4604-8293-b5b9a739c17d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:12.561388 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40144a36-5c78-4604-8293-b5b9a739c17d admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:12.573726 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-40144a36-5c78-4604-8293-b5b9a739c17d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1b76dd4d-8a1f-42b0-aea0-ecba3626c942 HTTP/1.1" status: 204 len: 168 time: 0.1934016 Jan 05 15:00:12.573726 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40144a36-5c78-4604-8293-b5b9a739c17d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b76dd4d-8a1f-42b0-aea0-ecba3626c942,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:12.714894 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:12.717458 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc68709e-c32c-4337-844a-699f7833c5ae" -d '{"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:12.735755 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25eba272-c39e-4fbd-80d0-37f414437ed0 req-76677f2a-f9d2-4121-bbd6-06dc36986bbe tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:12.744679 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-25eba272-c39e-4fbd-80d0-37f414437ed0 req-76677f2a-f9d2-4121-bbd6-06dc36986bbe tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0718424 Jan 05 15:00:12.766440 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4ccd0ba-7748-46d6-a705-582f83693212 x-openstack-request-id: req-d4ccd0ba-7748-46d6-a705-582f83693212 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:12.766926 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:12.767013 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d4ccd0ba-7748-46d6-a705-582f83693212 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:12.768805 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc', 'code': 200} Jan 05 15:00:12.792818 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-25eba272-c39e-4fbd-80d0-37f414437ed0 req-f8c18f57-aa3a-4f20-bbca-c65766bc443f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470655 Jan 05 15:00:12.911500 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd req-c5b8d818-ce54-457d-9cff-e0e3ce9ac8f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:12.913150 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd req-c5b8d818-ce54-457d-9cff-e0e3ce9ac8f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0520029 Jan 05 15:00:12.964641 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-87163e7e-dae2-40be-82a4-ddb2fb3be6dd req-cfe5b957-540e-47f7-b661-67483c4c73e2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451424 Jan 05 15:00:13.172576 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42518) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:13.185211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8650a030-3f46-4bb0-85eb-34c344077e50 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:13.260267 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8650a030-3f46-4bb0-85eb-34c344077e50 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:13.330096 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8650a030-3f46-4bb0-85eb-34c344077e50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:13.379053 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-8650a030-3f46-4bb0-85eb-34c344077e50 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=699a163c4a354ae0afd7674bc0d1562c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2052674 Jan 05 15:00:13.379744 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8650a030-3f46-4bb0-85eb-34c344077e50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5eeeff9-6146-4522-a5e0-5b818986fa8a,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:13.381934 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42528) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:13.395661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c83de59-de0d-4db7-afc1-8bc2767c2238 req-b77ca192-9e36-45c6-aeef-28386a0373c8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:13.397115 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2c83de59-de0d-4db7-afc1-8bc2767c2238 req-b77ca192-9e36-45c6-aeef-28386a0373c8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0942409 Jan 05 15:00:13.478988 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2c83de59-de0d-4db7-afc1-8bc2767c2238 req-56e4dfa0-0f8e-437b-96b8-f2230b213a07 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753696 Jan 05 15:00:13.482134 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fcfa974-1d2f-46b7-84f3-c168b0b52b59 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:13.504489 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fcfa974-1d2f-46b7-84f3-c168b0b52b59 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:13.617236 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fcfa974-1d2f-46b7-84f3-c168b0b52b59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:13.619945 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fcfa974-1d2f-46b7-84f3-c168b0b52b59 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:13.621135 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2fcfa974-1d2f-46b7-84f3-c168b0b52b59 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a5eeeff9-6146-4522-a5e0-5b818986fa8a HTTP/1.1" status: 204 len: 168 time: 0.2375152 Jan 05 15:00:13.631117 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcfa974-1d2f-46b7-84f3-c168b0b52b59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5eeeff9-6146-4522-a5e0-5b818986fa8a,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:13.913112 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849a4816-096e-4a07-bf66-fd3b7c660d00 req-8ec0aa24-b976-4cdb-8dad-23d842f31efd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:13.915080 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-849a4816-096e-4a07-bf66-fd3b7c660d00 req-8ec0aa24-b976-4cdb-8dad-23d842f31efd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0507951 Jan 05 15:00:13.961930 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-849a4816-096e-4a07-bf66-fd3b7c660d00 req-cd26f328-73f1-407c-82b8-f29d037bba1e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417435 Jan 05 15:00:14.084553 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e40b19-2379-43af-b949-4b4d7d41353b req-ad4f0723-7bc9-492d-8ca7-c95df4e212dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:14.086097 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7e40b19-2379-43af-b949-4b4d7d41353b req-ad4f0723-7bc9-492d-8ca7-c95df4e212dd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0560896 Jan 05 15:00:14.163277 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7e40b19-2379-43af-b949-4b4d7d41353b req-bceade8c-e724-4693-a4e8-5ce92a46b8e9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657587 Jan 05 15:00:14.598605 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 req-9fb680f8-17ed-4dfc-99d5-ae2d268c29a9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:14.600073 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 req-9fb680f8-17ed-4dfc-99d5-ae2d268c29a9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0488224 Jan 05 15:00:14.653570 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17fdd0a1-1cb4-46c8-a249-aca0e0123b51 req-4faa81ed-361d-4f47-95be-cf490a581177 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473769 Jan 05 15:00:15.078232 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55efc6d1-b89d-480b-aa87-22d82318c4bc req-90128e90-1de3-4d24-84bb-28b25f967dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:15.079696 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-55efc6d1-b89d-480b-aa87-22d82318c4bc req-90128e90-1de3-4d24-84bb-28b25f967dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0475526 Jan 05 15:00:15.126818 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-55efc6d1-b89d-480b-aa87-22d82318c4bc req-28ff5b08-6a28-4670-a0fe-44f63b13a2e8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413768 Jan 05 15:00:15.273889 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fad29a6-8abf-43a8-b366-4f44677b310e req-2b861808-1a88-4096-a271-d1e408e1197f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:15.276257 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fad29a6-8abf-43a8-b366-4f44677b310e req-2b861808-1a88-4096-a271-d1e408e1197f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0534558 Jan 05 15:00:15.322377 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fad29a6-8abf-43a8-b366-4f44677b310e req-ac0e5749-56c0-4ef4-917c-e83c7960891f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404258 Jan 05 15:00:15.769927 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d74b86-87e1-4941-b58f-32260ee3cf46 req-93168952-7041-4831-b5e4-5205aac87ded tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:15.771519 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-71d74b86-87e1-4941-b58f-32260ee3cf46 req-93168952-7041-4831-b5e4-5205aac87ded tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0494149 Jan 05 15:00:15.817930 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-71d74b86-87e1-4941-b58f-32260ee3cf46 req-247c18a9-1de9-4dc4-8124-66f8f5991d9f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410054 Jan 05 15:00:15.976997 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c84000d-d2b1-41df-bfc5-befbbe02f171 req-60eb7401-b47d-4455-b93a-c4345c3c7c28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:15.978610 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5c84000d-d2b1-41df-bfc5-befbbe02f171 req-60eb7401-b47d-4455-b93a-c4345c3c7c28 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1099 time: 0.0470777 Jan 05 15:00:16.044573 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5c84000d-d2b1-41df-bfc5-befbbe02f171 req-5ebc758d-9543-4f3d-b256-5315c1e75172 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372975 Jan 05 15:00:16.258517 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae02049d-d750-41d5-86cb-1bdebc269c53 req-6610a723-ffe1-440a-b469-e96c11b9286f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:16.260618 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ae02049d-d750-41d5-86cb-1bdebc269c53 req-6610a723-ffe1-440a-b469-e96c11b9286f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0588245 Jan 05 15:00:16.310386 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ae02049d-d750-41d5-86cb-1bdebc269c53 req-c3d7fc93-191a-43fc-b6fe-ffb2d5ea2cb3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426369 Jan 05 15:00:16.443833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f1f3bf-4652-49e9-840c-8e8eb195477b req-8b36ed65-729d-4f50-babf-b4e5449a8719 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:16.445342 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75f1f3bf-4652-49e9-840c-8e8eb195477b req-8b36ed65-729d-4f50-babf-b4e5449a8719 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0536819 Jan 05 15:00:16.509220 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75f1f3bf-4652-49e9-840c-8e8eb195477b req-3a02712e-83ec-4ec3-8e84-a1446229e879 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466592 Jan 05 15:00:16.651471 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d8415b1-2ff3-4685-b694-77d176e0e676 req-3d82d0ef-9d96-433f-8562-3ece1d6a1042 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:16.652990 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6d8415b1-2ff3-4685-b694-77d176e0e676 req-3d82d0ef-9d96-433f-8562-3ece1d6a1042 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0499320 Jan 05 15:00:16.661467 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42634) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:16.665876 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'floatingip': {'port_id': '2886de19-8aa3-470c-a593-9381bdb36ca0'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:16.741305 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:17.014674 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b req-8f2c0563-8da9-42e5-bada-9a609b3361ca tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:17.016990 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b req-8f2c0563-8da9-42e5-bada-9a609b3361ca tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.1316457 Jan 05 15:00:17.186923 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6fec9cd4-a559-4d8d-81fd-5ee257141f3b req-53eac227-e65c-494a-a19e-e67805110600 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1627858 Jan 05 15:00:17.590804 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd44ec1c-209b-44b2-bece-eaee84361148 req-0ec74fc3-42ad-4053-a406-7f472ba518f3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:17.592186 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dd44ec1c-209b-44b2-bece-eaee84361148 req-0ec74fc3-42ad-4053-a406-7f472ba518f3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.1716778 Jan 05 15:00:17.702934 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:17.714299 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dd44ec1c-209b-44b2-bece-eaee84361148 req-e73ab56b-9b00-4ab9-9728-17baf3b0c126 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1124990 Jan 05 15:00:17.798179 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9def92cc-22cc-4dae-aa99-b43f181c7d64 req-0c9bd90c-43d1-439c-90af-104e1ae47d68 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:17.799669 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9def92cc-22cc-4dae-aa99-b43f181c7d64 req-0c9bd90c-43d1-439c-90af-104e1ae47d68 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0479646 Jan 05 15:00:17.802029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:17.852326 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9def92cc-22cc-4dae-aa99-b43f181c7d64 req-cde14b71-a513-4208-a917-3e24eaa352be tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447364 Jan 05 15:00:17.910019 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Floating IP 6c329830-7016-424d-a758-395eb597052f associated. External IP: 172.37.2.32, port: 2886de19-8aa3-470c-a593-9381bdb36ca0. Jan 05 15:00:18.182980 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Router d3c49f70-ad09-435c-bdeb-024562318429 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:00:18.293111 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:00:18.299022 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:18.315172 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] Sync routers for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:00:18.320084 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:00:18.320705 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:00:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:18.329935 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-83a9c923-69ff-4881-9849-7f95ae39c54e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "PUT /v2.0/floatingips/6c329830-7016-424d-a758-395eb597052f HTTP/1.1" status: 200 len: 990 time: 1.6673925 Jan 05 15:00:18.330526 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:18.333225 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7be2093-627e-4cfd-a2d8-33762caa2e47" -d '{"events": [{"name": "network-changed", "server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:18.370451 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 x-openstack-request-id: req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:18.370754 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:18.371013 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0df93089-3ffd-4ccb-85b5-031ddd3d58c2 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:18.372222 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'status': 'completed', 'code': 200} Jan 05 15:00:18.429243 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:00:18.693147 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '6c329830-7016-424d-a758-395eb597052f', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'floating_ip_address': '172.37.2.32', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'port_id': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'mac_address': 'fa:16:3e:90:e0:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3327c27f-a8e9-4b19-8041-fb5260278159', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T14:59:42Z', 'updated_at': '2022-01-05T15:00:17Z', 'revision_number': 1, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:18.719001 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] Checking router: d3c49f70-ad09-435c-bdeb-024562318429 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:00:18.727273 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:00:18.727867 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:00:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:18.832495 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:00:18.843426 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c716058c-3f34-4e94-a854-fcd2e086e297 req-b5b97d32-31fc-4b76-b274-32ad48ffc5fc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:18.844927 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c716058c-3f34-4e94-a854-fcd2e086e297 req-b5b97d32-31fc-4b76-b274-32ad48ffc5fc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0502591 Jan 05 15:00:18.894975 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c716058c-3f34-4e94-a854-fcd2e086e297 req-35c80068-c7f5-42c1-9101-147daa47a378 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441637 Jan 05 15:00:19.022177 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3875ac16-889e-4699-a693-d81fa7001b55 req-db72ea5a-d29f-43dc-a56d-4da48e2391b1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:19.023536 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3875ac16-889e-4699-a693-d81fa7001b55 req-db72ea5a-d29f-43dc-a56d-4da48e2391b1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0504222 Jan 05 15:00:19.063112 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '6c329830-7016-424d-a758-395eb597052f', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'floating_ip_address': '172.37.2.32', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'port_id': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'mac_address': 'fa:16:3e:90:e0:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3327c27f-a8e9-4b19-8041-fb5260278159', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T14:59:42Z', 'updated_at': '2022-01-05T15:00:17Z', 'revision_number': 1, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:19.069584 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3875ac16-889e-4699-a693-d81fa7001b55 req-218d04bf-787c-4ba0-b2b7-6fd4f0be827d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399516 Jan 05 15:00:19.089242 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fffe8ea8-3af7-455d-9261-818e4ac1d258 None None] The sync data for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi is: [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '6c329830-7016-424d-a758-395eb597052f', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'floating_ip_address': '172.37.2.32', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'port_id': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'mac_address': 'fa:16:3e:90:e0:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3327c27f-a8e9-4b19-8041-fb5260278159', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T14:59:42Z', 'updated_at': '2022-01-05T15:00:17Z', 'revision_number': 1, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:00:19.296654 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d84d838a-eae2-4f87-a14e-95af59a5a11b None None] New status for floating IP 6c329830-7016-424d-a758-395eb597052f: ACTIVE {{(pid=114656) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:00:20.018929 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 req-53c3bd13-5990-43f5-bee7-28879b4b3ea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:20.020362 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 req-53c3bd13-5990-43f5-bee7-28879b4b3ea5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0472865 Jan 05 15:00:20.066133 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1597c5f5-1e73-4449-8e4d-5d940888e0c7 req-dc8624be-2536-4f40-8f60-1d3ff8dcb310 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401585 Jan 05 15:00:20.314695 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9db5794-b09b-4500-ac6b-67736df8f567 req-ccfcd226-7b29-49a7-bf74-4dcf4f3b820d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:20.316020 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c9db5794-b09b-4500-ac6b-67736df8f567 req-ccfcd226-7b29-49a7-bf74-4dcf4f3b820d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0496430 Jan 05 15:00:20.361975 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c9db5794-b09b-4500-ac6b-67736df8f567 req-6275e76c-80de-443c-94b5-772716e65ef5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405350 Jan 05 15:00:20.945506 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-41191da7-6192-4368-9a95-c2da268769c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:20.946126 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c08678-a659-4899-87bf-077fc0073ee1 req-205445fa-307b-4221-8b71-203bd8dc6e53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:20.946997 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-41191da7-6192-4368-9a95-c2da268769c6 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 1098 time: 0.0398095 Jan 05 15:00:20.947243 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57c08678-a659-4899-87bf-077fc0073ee1 req-205445fa-307b-4221-8b71-203bd8dc6e53 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 1099 time: 0.0382171 Jan 05 15:00:21.066278 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-5b257d08-a790-4241-852e-420332667b7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:21.067835 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-5b257d08-a790-4241-852e-420332667b7e service neutron] 10.222.0.13 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 911 time: 0.0845289 Jan 05 15:00:21.132233 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c08678-a659-4899-87bf-077fc0073ee1 req-4584314a-fb80-4275-847c-eb444e00eb5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:21.134123 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57c08678-a659-4899-87bf-077fc0073ee1 req-4584314a-fb80-4275-847c-eb444e00eb5b service neutron] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 920 time: 0.1503696 Jan 05 15:00:21.171107 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-553ac796-4483-4126-80cc-bd8438cac331 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2886de19-8aa3-470c-a593-9381bdb36ca0 HTTP/1.1" status: 200 len: 1000 time: 0.0971630 Jan 05 15:00:21.200784 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57c08678-a659-4899-87bf-077fc0073ee1 req-cab229b0-7d13-4e36-bcce-ef407746d242 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=94077c14-de44-48f3-8ca4-3b1be238b708 HTTP/1.1" status: 200 len: 217 time: 0.0570581 Jan 05 15:00:21.223562 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-4b922d8a-6cc9-445e-b0c4-a1fd5f6ef25c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:21.225025 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-4b922d8a-6cc9-445e-b0c4-a1fd5f6ef25c service neutron] 10.222.0.13 "GET /v2.0/subnets?id=fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 200 len: 849 time: 0.0437353 Jan 05 15:00:21.228664 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75380eca-be54-4628-955a-5451b92df35a req-a60db24a-66b7-4834-b831-90cee6342529 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:21.230355 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-75380eca-be54-4628-955a-5451b92df35a req-a60db24a-66b7-4834-b831-90cee6342529 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0884600 Jan 05 15:00:21.282034 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-a60822f8-1698-49b9-b4bc-c3f7c0d43aa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:21.283513 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-a60822f8-1698-49b9-b4bc-c3f7c0d43aa1 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fb7bcda7-5039-4d82-bf68-12c9acc8a744&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0440140 Jan 05 15:00:21.284467 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c08678-a659-4899-87bf-077fc0073ee1 req-4385633e-188b-48bd-9233-3d173aca16ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:21.285878 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57c08678-a659-4899-87bf-077fc0073ee1 req-4385633e-188b-48bd-9233-3d173aca16ea service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0748289 Jan 05 15:00:21.301289 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-75380eca-be54-4628-955a-5451b92df35a req-b1334e64-dd83-46d1-8cb4-302bae2b4233 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538690 Jan 05 15:00:21.336308 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57c08678-a659-4899-87bf-077fc0073ee1 req-06c508f8-90e3-47b9-9147-267ff2468cbd service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0243669 Jan 05 15:00:21.406142 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-aa62096c-6cc7-499a-9e2d-01ec6df10d19 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0914655 Jan 05 15:00:21.430261 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57c08678-a659-4899-87bf-077fc0073ee1 req-9623d3a6-aca5-4f9f-ab81-4d2e2d5c45b7 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853055 Jan 05 15:00:21.531020 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb req-8481bf14-7843-4c11-a306-7d95108b7128 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:21.532901 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb req-8481bf14-7843-4c11-a306-7d95108b7128 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0920322 Jan 05 15:00:21.549299 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57c08678-a659-4899-87bf-077fc0073ee1 req-ddb743af-ed9e-4c76-b1ed-1e408fa76878 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1133373 Jan 05 15:00:21.576120 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e7be2093-627e-4cfd-a2d8-33762caa2e47 req-1bba3c52-ca33-482d-9c9f-3750471ac673 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1545391 Jan 05 15:00:21.601340 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-599fbca8-df57-4e22-b980-8e6c5cc2e1bb req-db78543c-b329-43cf-b613-6c44c31e0be5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592232 Jan 05 15:00:22.420739 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661dc4eb-efce-4941-aeae-67b089d5b78d req-2f0ae4ba-382c-43b1-80fd-1e4dd737b12d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:22.422557 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-661dc4eb-efce-4941-aeae-67b089d5b78d req-2f0ae4ba-382c-43b1-80fd-1e4dd737b12d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0490980 Jan 05 15:00:22.480140 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-661dc4eb-efce-4941-aeae-67b089d5b78d req-4d32c38b-4d23-4c97-a583-c74b94d1b2c7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515389 Jan 05 15:00:22.736692 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cffced0a-0155-4f3c-94a9-462b07a49425 req-79855025-3687-4cec-b7fb-49212545da86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:22.741776 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cffced0a-0155-4f3c-94a9-462b07a49425 req-79855025-3687-4cec-b7fb-49212545da86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0580757 Jan 05 15:00:22.789653 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d7ca165-f5c5-45de-bcee-1995e299d25b req-117c668c-74af-403d-9c00-59a286fce16a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:22.791132 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6d7ca165-f5c5-45de-bcee-1995e299d25b req-117c668c-74af-403d-9c00-59a286fce16a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.2398374 Jan 05 15:00:22.796551 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cffced0a-0155-4f3c-94a9-462b07a49425 req-b22e9ebc-978b-4679-bf7b-f022c430023a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501084 Jan 05 15:00:22.801234 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42804) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:22.805713 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'floatingip': {'port_id': '45483c3c-9f42-4aff-a962-22ff36647afc'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:22.846745 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.279966 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42812) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:23.387633 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.459600 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.467757 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.537002 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.550587 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.575092 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-82111222-7222-481f-a808-2628c59de61a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=29572d5cbb0847bab8664679e31ad7b5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2934189 Jan 05 15:00:23.576023 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4dd621a-3760-4f24-9d7c-8070f1a478c8,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:23.578011 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42818) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:23.593481 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.596488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.597302 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.597302 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.597302 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82111222-7222-481f-a808-2628c59de61a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:23.639296 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2aee419f-4065-4e9f-a8d5-eec6397ce325 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.651813 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Floating IP 7c474e8a-c72f-413b-9e04-47dc9cef12cc associated. External IP: 172.37.2.180, port: 45483c3c-9f42-4aff-a962-22ff36647afc. Jan 05 15:00:23.659656 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2aee419f-4065-4e9f-a8d5-eec6397ce325 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.796832 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2aee419f-4065-4e9f-a8d5-eec6397ce325 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.799430 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2aee419f-4065-4e9f-a8d5-eec6397ce325 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:23.800582 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2aee419f-4065-4e9f-a8d5-eec6397ce325 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c4dd621a-3760-4f24-9d7c-8070f1a478c8 HTTP/1.1" status: 204 len: 168 time: 0.2216861 Jan 05 15:00:23.811629 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aee419f-4065-4e9f-a8d5-eec6397ce325 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4dd621a-3760-4f24-9d7c-8070f1a478c8,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:23.919039 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Router 9ec87e52-56d6-4808-9eb4-61d2fe146230 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:00:23.949660 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931f1672-4c53-46ea-b6e7-47de87a69c5a req-05a00b07-186e-4a62-81a1-396e3031e56a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:23.951152 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-931f1672-4c53-46ea-b6e7-47de87a69c5a req-05a00b07-186e-4a62-81a1-396e3031e56a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0644321 Jan 05 15:00:24.068554 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-931f1672-4c53-46ea-b6e7-47de87a69c5a req-291dc16b-87e1-4c5c-8f99-b17dbf6dd78b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835469 Jan 05 15:00:24.080500 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:00:24.084904 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:24.090087 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] Sync routers for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:00:24.099704 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:00:24.105629 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:00:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:24.118617 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d85a521a-dd55-4898-9764-7e1cda6cf30e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "PUT /v2.0/floatingips/7c474e8a-c72f-413b-9e04-47dc9cef12cc HTTP/1.1" status: 200 len: 992 time: 1.3136063 Jan 05 15:00:24.118617 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:24.118873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6" -d '{"events": [{"name": "network-changed", "server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:24.210307 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:00:24.515853 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '7c474e8a-c72f-413b-9e04-47dc9cef12cc', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'floating_ip_address': '172.37.2.180', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'port_id': '45483c3c-9f42-4aff-a962-22ff36647afc', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 130, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'mac_address': 'fa:16:3e:25:44:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T14:59:53Z', 'updated_at': '2022-01-05T15:00:23Z', 'revision_number': 1, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:24.542317 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] Checking router: 9ec87e52-56d6-4808-9eb4-61d2fe146230 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:00:24.551039 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:00:24.551626 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:00:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:24.605006 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42842) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:24.618231 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c59039c8-36d1-42a8-bbde-ebad0a2c3293 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:24.655816 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:00:24.688821 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c59039c8-36d1-42a8-bbde-ebad0a2c3293 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:24.818914 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c59039c8-36d1-42a8-bbde-ebad0a2c3293 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:24.859113 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c59039c8-36d1-42a8-bbde-ebad0a2c3293 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1a02745c139b45baa1fd9d5289f9599e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2528949 Jan 05 15:00:24.859784 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42846) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:24.860699 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59039c8-36d1-42a8-bbde-ebad0a2c3293 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90ef0e38-3d10-4872-b063-ecee85097a01,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:24.876878 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '7c474e8a-c72f-413b-9e04-47dc9cef12cc', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'floating_ip_address': '172.37.2.180', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'port_id': '45483c3c-9f42-4aff-a962-22ff36647afc', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 130, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'mac_address': 'fa:16:3e:25:44:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T14:59:53Z', 'updated_at': '2022-01-05T15:00:23Z', 'revision_number': 1, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:24.907106 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-735e5a84-b244-4ba3-b684-76b98c6ce7c5 None None] The sync data for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi is: [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '7c474e8a-c72f-413b-9e04-47dc9cef12cc', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'floating_ip_address': '172.37.2.180', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'port_id': '45483c3c-9f42-4aff-a962-22ff36647afc', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 130, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'mac_address': 'fa:16:3e:25:44:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T14:59:53Z', 'updated_at': '2022-01-05T15:00:23Z', 'revision_number': 1, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:00:24.909665 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:24.932965 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:25.114557 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98d9b887-a943-423d-9589-384ed43fe867 None None] New status for floating IP 7c474e8a-c72f-413b-9e04-47dc9cef12cc: ACTIVE {{(pid=114656) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:00:25.120896 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/90ef0e38-3d10-4872-b063-ecee85097a01 HTTP/1.1" status: 204 len: 168 time: 0.2642608 Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90ef0e38-3d10-4872-b063-ecee85097a01,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.231752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60842197-0795-44da-b20e-67e28e577b62 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:00:25.723074 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9105904c-d5dd-44e3-9379-ebffcdafabef x-openstack-request-id: req-9105904c-d5dd-44e3-9379-ebffcdafabef {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:25.723717 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:25.724049 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9105904c-d5dd-44e3-9379-ebffcdafabef {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:25.724391 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc', 'status': 'completed', 'code': 200} Jan 05 15:00:25.818721 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 req-70ff05cd-767f-4a33-806e-a837495eb0ec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:25.825592 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 req-70ff05cd-767f-4a33-806e-a837495eb0ec tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0575047 Jan 05 15:00:25.853523 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-92741a3f-bf0e-47dc-bbdf-4864ed8f651c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:25.855871 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-92741a3f-bf0e-47dc-bbdf-4864ed8f651c service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1099 time: 0.0546329 Jan 05 15:00:25.871662 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-083eb67c-c4bc-42f4-b4a8-7142d71bda83 req-5d3a9d59-ef82-4c8e-879b-00819296f801 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452003 Jan 05 15:00:25.946546 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-61a6e8bf-90b6-405d-b6d7-c0f90001605f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:25.950366 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-61a6e8bf-90b6-405d-b6d7-c0f90001605f service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.0859108 Jan 05 15:00:26.017588 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-8488ac6e-3445-4ae5-b539-27b8e1ee26fc service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=45483c3c-9f42-4aff-a962-22ff36647afc HTTP/1.1" status: 200 len: 1002 time: 0.0579228 Jan 05 15:00:26.096469 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-54823f43-6d38-45ef-88ab-a3e1372ec564 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:26.098271 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-54823f43-6d38-45ef-88ab-a3e1372ec564 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0729911 Jan 05 15:00:26.148673 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-a78d067b-4356-4e7e-baac-6b73dae8a226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:26.150203 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-a78d067b-4356-4e7e-baac-6b73dae8a226 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0448105 Jan 05 15:00:26.239169 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-6bf9b8cf-c712-42ac-942b-47f9ae8c6c96 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820887 Jan 05 15:00:26.341653 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b1a0af80-80c2-45a7-9df4-d801b7ee88a6 req-a42486dc-66a7-4de6-8ee8-40f0864eb8d6 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938404 Jan 05 15:00:27.002446 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d231789-3f93-480a-9b1f-6c8ff870dea5 req-75174bf4-d106-491c-9ed1-99193d3aa5db tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:27.004173 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9d231789-3f93-480a-9b1f-6c8ff870dea5 req-75174bf4-d106-491c-9ed1-99193d3aa5db tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0521872 Jan 05 15:00:27.050838 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9d231789-3f93-480a-9b1f-6c8ff870dea5 req-63e93913-bbc6-4bad-8932-3adb5b8221a2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413580 Jan 05 15:00:27.767774 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 42940) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:27.895601 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8cc77036-191c-4645-861d-b22c70d2d017 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:27.969596 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8cc77036-191c-4645-861d-b22c70d2d017 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:28.184928 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869ab80d-5d2b-43b2-abf0-80d193fd8490 req-f2a4afa2-6515-4607-a792-7473f1f31485 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:28.186448 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-869ab80d-5d2b-43b2-abf0-80d193fd8490 req-f2a4afa2-6515-4607-a792-7473f1f31485 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0547025 Jan 05 15:00:28.236712 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-869ab80d-5d2b-43b2-abf0-80d193fd8490 req-c41ad629-ba72-456c-9b6f-315d9a21d9c9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440776 Jan 05 15:00:28.265566 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8cc77036-191c-4645-861d-b22c70d2d017 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:28.307625 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-8cc77036-191c-4645-861d-b22c70d2d017 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9516c82e7cd04567a9518309976f2a68&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5364311 Jan 05 15:00:28.308776 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cc77036-191c-4645-861d-b22c70d2d017 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=126d17f4-8d70-47ef-a404-b6b3e5073084,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:28.310321 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42966) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:28.312131 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-9905a0d0-9c72-4f91-9a4f-75c8493b20b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:28.360208 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3b9047e0-2631-48e3-8f4e-07dfed30e011 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:28.381982 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3b9047e0-2631-48e3-8f4e-07dfed30e011 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:28.533351 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3b9047e0-2631-48e3-8f4e-07dfed30e011 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:28.535992 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3b9047e0-2631-48e3-8f4e-07dfed30e011 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:28.539288 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-3b9047e0-2631-48e3-8f4e-07dfed30e011 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/126d17f4-8d70-47ef-a404-b6b3e5073084 HTTP/1.1" status: 204 len: 168 time: 0.2257500 Jan 05 15:00:28.553399 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b9047e0-2631-48e3-8f4e-07dfed30e011 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=126d17f4-8d70-47ef-a404-b6b3e5073084,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:28.977286 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 42984) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:29.082833 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-622a01a4-1a66-4d8f-bc22-2ad542c90bd1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:29.189333 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-622a01a4-1a66-4d8f-bc22-2ad542c90bd1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:29.298923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-622a01a4-1a66-4d8f-bc22-2ad542c90bd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:29.337462 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-622a01a4-1a66-4d8f-bc22-2ad542c90bd1 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d2e70120e3df4e20809c528d5ec9b559&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3590314 Jan 05 15:00:29.338627 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622a01a4-1a66-4d8f-bc22-2ad542c90bd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acfcb8cd-909b-4979-a990-182d952cf82d,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:29.340104 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43006) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:29.388974 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e0a5014-0654-476e-a81a-55680a86fe15 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:29.410707 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e0a5014-0654-476e-a81a-55680a86fe15 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:29.536939 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e0a5014-0654-476e-a81a-55680a86fe15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:29.539691 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e0a5014-0654-476e-a81a-55680a86fe15 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:29.540942 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7e0a5014-0654-476e-a81a-55680a86fe15 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/acfcb8cd-909b-4979-a990-182d952cf82d HTTP/1.1" status: 204 len: 168 time: 0.1997945 Jan 05 15:00:29.549474 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e0a5014-0654-476e-a81a-55680a86fe15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acfcb8cd-909b-4979-a990-182d952cf82d,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:30.359228 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43036) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:30.371970 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2012a89a-4ce2-4743-a321-65633633e66d admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.402222 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-dd3d3e8b-770e-4d96-9caf-ace02df1155f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.448103 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2012a89a-4ce2-4743-a321-65633633e66d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.536414 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2012a89a-4ce2-4743-a321-65633633e66d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.540804 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43040) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:30.574567 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2012a89a-4ce2-4743-a321-65633633e66d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ac43553375354afcbd485036bcf06400&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2141955 Jan 05 15:00:30.575290 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2012a89a-4ce2-4743-a321-65633633e66d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92c61ba4-5a6d-4a33-9c33-16aba5b0f9c4,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:30.577704 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43044) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:30.624914 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e85bd90a-1874-413a-920e-2cf9c3f430d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.647337 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-45f1973b-7844-4310-b38d-4e7f50bd4a9f admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.648308 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e85bd90a-1874-413a-920e-2cf9c3f430d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.720732 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-45f1973b-7844-4310-b38d-4e7f50bd4a9f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.759520 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e85bd90a-1874-413a-920e-2cf9c3f430d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.762145 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e85bd90a-1874-413a-920e-2cf9c3f430d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.763299 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-e85bd90a-1874-413a-920e-2cf9c3f430d9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/92c61ba4-5a6d-4a33-9c33-16aba5b0f9c4 HTTP/1.1" status: 204 len: 168 time: 0.1847124 Jan 05 15:00:30.770961 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85bd90a-1874-413a-920e-2cf9c3f430d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92c61ba4-5a6d-4a33-9c33-16aba5b0f9c4,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:30.796774 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-45f1973b-7844-4310-b38d-4e7f50bd4a9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.833998 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-45f1973b-7844-4310-b38d-4e7f50bd4a9f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=32fe48e21f974e40a2572958509e896b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2920787 Jan 05 15:00:30.836043 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f1973b-7844-4310-b38d-4e7f50bd4a9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b01acd85-5176-436e-ad0e-8bd047d99234,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:30.836614 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43050) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:30.885094 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-26822f46-6b35-44f2-a756-bb6db1fb0986 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:30.907694 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-26822f46-6b35-44f2-a756-bb6db1fb0986 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:31.087695 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-26822f46-6b35-44f2-a756-bb6db1fb0986 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:31.090334 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-26822f46-6b35-44f2-a756-bb6db1fb0986 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:31.091631 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-26822f46-6b35-44f2-a756-bb6db1fb0986 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b01acd85-5176-436e-ad0e-8bd047d99234 HTTP/1.1" status: 204 len: 168 time: 0.2539535 Jan 05 15:00:31.099892 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26822f46-6b35-44f2-a756-bb6db1fb0986 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b01acd85-5176-436e-ad0e-8bd047d99234,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:31.834340 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:31.929329 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-804e733f-8bc3-47b2-b679-063bd90ed0cc req-a3be2218-b7f3-4461-aab4-28dcb213277c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:31.930949 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-804e733f-8bc3-47b2-b679-063bd90ed0cc req-a3be2218-b7f3-4461-aab4-28dcb213277c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0582335 Jan 05 15:00:31.987116 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-804e733f-8bc3-47b2-b679-063bd90ed0cc req-5778250f-b28b-46c9-a1c8-a6cab153c32f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504751 Jan 05 15:00:32.760121 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:33.513709 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:34.407235 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:35.232137 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9544c204-937d-4b8d-8719-696fdcba22b5 req-7da3ce96-7462-49a2-ab77-3d60846bc90f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:35.233621 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9544c204-937d-4b8d-8719-696fdcba22b5 req-7da3ce96-7462-49a2-ab77-3d60846bc90f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0504487 Jan 05 15:00:35.281329 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9544c204-937d-4b8d-8719-696fdcba22b5 req-6112ceef-726d-4ea3-957f-cf003373d6f1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416212 Jan 05 15:00:36.427302 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1547eab2-7723-4eaf-b320-215b71dba76d req-0bca7850-eedb-4ff8-aa7d-d4b4ce594ddb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:36.428920 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1547eab2-7723-4eaf-b320-215b71dba76d req-0bca7850-eedb-4ff8-aa7d-d4b4ce594ddb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0571275 Jan 05 15:00:36.481974 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1547eab2-7723-4eaf-b320-215b71dba76d req-9104081f-02fc-438b-bac3-e9d64153d6a6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467236 Jan 05 15:00:37.338215 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-275696f3-9d31-4595-ba63-7bbaf628f19d service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0375953 Jan 05 15:00:37.564430 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-2c5e61c7-e504-4a6e-bf28-a8e7b11fba39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:37.564430 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-2c5e61c7-e504-4a6e-bf28-a8e7b11fba39 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=fc623d81b10e491ab3a65d62b99bf7c7&device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 1098 time: 0.0427964 Jan 05 15:00:37.714838 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e152cd3e-d50b-4027-ac1a-e24138da5de7 req-244b207b-dc0b-457a-b8fd-e2e92af0051a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:37.716663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e152cd3e-d50b-4027-ac1a-e24138da5de7 req-244b207b-dc0b-457a-b8fd-e2e92af0051a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0813355 Jan 05 15:00:37.717837 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-0c6e22b6-ea66-440c-b5e4-4f9110ccc60e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:37.719195 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-0c6e22b6-ea66-440c-b5e4-4f9110ccc60e service neutron] 10.222.0.13 "GET /v2.0/networks?id=fca65618-396e-44a0-8e47-55fa90240fd2 HTTP/1.1" status: 200 len: 912 time: 0.1405206 Jan 05 15:00:37.790014 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-3c07dbb9-6834-4f7c-a1a9-7b60ac3d8bea service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=a1de646c-827f-41ad-bab9-8457e33db96d HTTP/1.1" status: 200 len: 217 time: 0.0530279 Jan 05 15:00:37.856424 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e152cd3e-d50b-4027-ac1a-e24138da5de7 req-daeec032-8f71-4bca-a7bd-dbdc773e007f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211946 Jan 05 15:00:37.856424 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-87ffa513-840c-4855-84ed-764182d3204a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:37.857218 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-87ffa513-840c-4855-84ed-764182d3204a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=851aa76f-ccc4-4997-b93f-8238639e6bfa HTTP/1.1" status: 200 len: 851 time: 0.0564861 Jan 05 15:00:37.890838 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-e8a43665-ba04-4bbd-acf5-10a6c99a1716 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fca65618-396e-44a0-8e47-55fa90240fd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236852 Jan 05 15:00:37.991226 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-11bda59e-bd9f-4176-8e05-e141df861243 service neutron] 10.222.0.13 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842633 Jan 05 15:00:38.460296 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33247a44-431e-4796-bf34-b60d7253c9b7 req-18294fc6-aa94-489b-ada9-a0cdf3904897 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:38.461787 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-33247a44-431e-4796-bf34-b60d7253c9b7 req-18294fc6-aa94-489b-ada9-a0cdf3904897 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0489106 Jan 05 15:00:38.507452 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-33247a44-431e-4796-bf34-b60d7253c9b7 req-13703a33-4bc1-4c3b-8eb8-042ccc310f48 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401921 Jan 05 15:00:40.960566 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:00:41.180025 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40a107e6-208d-4899-98a4-c1109c3ab05d req-1e52644e-0074-4af2-8c4c-07659540bf95 service neutron] 10.222.0.13 "GET /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0948999 Jan 05 15:00:41.254155 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d918d6e-e369-4693-bcfd-ce77b57a3884 req-4230059e-71fa-403d-99dc-b81a9296efcc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:41.255669 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8d918d6e-e369-4693-bcfd-ce77b57a3884 req-4230059e-71fa-403d-99dc-b81a9296efcc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0502155 Jan 05 15:00:41.312553 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8d918d6e-e369-4693-bcfd-ce77b57a3884 req-2ad97366-497b-471c-8d47-abb016593080 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495915 Jan 05 15:00:41.318717 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 req-7b82671e-9cfe-409d-b32c-4630844d250a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:41.320199 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 req-7b82671e-9cfe-409d-b32c-4630844d250a tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0509634 Jan 05 15:00:41.367311 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d5e807f2-46cf-41bb-af4b-3d1f56392e97 req-b19de391-a6d4-4857-ba4a-e988cf176ed0 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411613 Jan 05 15:00:42.460251 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eae197e-cba6-4fd1-9b5e-933a7b57847a req-6da2668a-571f-407c-8bfa-a540c0f7adde tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:42.462142 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2eae197e-cba6-4fd1-9b5e-933a7b57847a req-6da2668a-571f-407c-8bfa-a540c0f7adde tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0629740 Jan 05 15:00:42.532496 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c48f94c-6ec8-405f-882e-c235db9650ad req-a8385c78-b0ce-4756-a5a7-e2c06ed9f5cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:42.532496 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3c48f94c-6ec8-405f-882e-c235db9650ad req-a8385c78-b0ce-4756-a5a7-e2c06ed9f5cf tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0746584 Jan 05 15:00:42.547755 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2eae197e-cba6-4fd1-9b5e-933a7b57847a req-26652e0c-f005-4de8-9a3f-fcb98830637d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780497 Jan 05 15:00:42.581789 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3c48f94c-6ec8-405f-882e-c235db9650ad req-9b6efe75-123c-4578-9d44-126b57d240d6 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475690 Jan 05 15:00:42.852932 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43356) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:42.955315 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82045196-fcce-465e-9b42-50700af556e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:43.026374 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82045196-fcce-465e-9b42-50700af556e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:43.104683 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-82045196-fcce-465e-9b42-50700af556e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:43.144105 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-82045196-fcce-465e-9b42-50700af556e4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ebb844dd6232470fa17f96fec5472992&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2900660 Jan 05 15:00:43.145448 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82045196-fcce-465e-9b42-50700af556e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e835a6a-467f-488e-958d-040c49e7e770,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:43.146833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43360) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:43.200416 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66708875-cc17-4ab5-8770-dc7fa499a3c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:43.221252 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66708875-cc17-4ab5-8770-dc7fa499a3c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:43.339445 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66708875-cc17-4ab5-8770-dc7fa499a3c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:43.341993 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66708875-cc17-4ab5-8770-dc7fa499a3c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:43.343621 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-66708875-cc17-4ab5-8770-dc7fa499a3c8 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4e835a6a-467f-488e-958d-040c49e7e770 HTTP/1.1" status: 204 len: 168 time: 0.1958184 Jan 05 15:00:43.351302 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66708875-cc17-4ab5-8770-dc7fa499a3c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e835a6a-467f-488e-958d-040c49e7e770,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:43.713815 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a req-9f979cb2-224a-4dd6-b49b-97d53b4f5617 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:43.715659 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a req-9f979cb2-224a-4dd6-b49b-97d53b4f5617 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0614815 Jan 05 15:00:43.750647 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a032895-ad49-4a70-920b-fd53e7461d82 req-5f1b4118-10b0-46bd-bfb2-2912deeaec84 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:43.753388 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5a032895-ad49-4a70-920b-fd53e7461d82 req-5f1b4118-10b0-46bd-bfb2-2912deeaec84 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0775678 Jan 05 15:00:43.795541 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-170bddd6-05b2-40c0-a06b-ca8a1e72c66a req-a69d331e-138a-4d10-b89e-9e4d71abfc7b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718708 Jan 05 15:00:43.816332 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5a032895-ad49-4a70-920b-fd53e7461d82 req-a2f26c9c-0fe4-42a6-b814-7b32dd41f43f tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567832 Jan 05 15:00:44.339530 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7088d042-d2d8-45a9-b463-955dbff684eb req-4a4749a8-5d36-4824-ae03-e1c68ff693f9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:44.340994 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7088d042-d2d8-45a9-b463-955dbff684eb req-4a4749a8-5d36-4824-ae03-e1c68ff693f9 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.13 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 945 time: 0.0489192 Jan 05 15:00:44.463325 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Deleting port a1de646c-827f-41ad-bab9-8457e33db96d {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:00:44.463797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:44.566653 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] For port a1de646c-827f-41ad-bab9-8457e33db96d, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a1de646c-827f-41ad-bab9-8457e33db96d,segment=NetworkSegment(9090f950-f416-4528-99a8-79f83e6339eb),segment_id=9090f950-f416-4528-99a8-79f83e6339eb)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:00:44.567018 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:44.582679 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Calling delete_port for a1de646c-827f-41ad-bab9-8457e33db96d owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:00:44.816658 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:44.846771 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Pushing event deleted for resources: {'Port': ['ID=a1de646c-827f-41ad-bab9-8457e33db96d,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:44.864907 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['a1de646c-827f-41ad-bab9-8457e33db96d'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:00:44.938817 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-495002c1-7f60-42cc-a77e-504218aee0c5 req-9e4169e2-21d0-4ffc-a9ce-5141d8422f61 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.0406168 Jan 05 15:00:44.958674 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] No DVR routers for this DVR port a1de646c-827f-41ad-bab9-8457e33db96d on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:00:44.964369 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:44.967797 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7088d042-d2d8-45a9-b463-955dbff684eb req-bc434a9e-9775-486c-b19c-b7d365235be3 tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.13 "DELETE /v2.0/ports/a1de646c-827f-41ad-bab9-8457e33db96d HTTP/1.1" status: 204 len: 173 time: 0.6180577 Jan 05 15:00:44.968548 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6cf86612-a721-4032-9b56-b9828fc658cd', 'name': 'network-vif-deleted', 'tag': 'a1de646c-827f-41ad-bab9-8457e33db96d'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:00:44.970523 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-632ea3e2-b66f-4449-bef3-1a084937d9e8" -d '{"events": [{"server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "name": "network-vif-deleted", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:00:44.989596 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8249d996-476a-48ca-bc74-88eba9e93c5b req-381cbc2d-3010-4aca-b51a-7ef48dfa50bc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:44.991083 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8249d996-476a-48ca-bc74-88eba9e93c5b req-381cbc2d-3010-4aca-b51a-7ef48dfa50bc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0981164 Jan 05 15:00:45.010975 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:00:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76f929e0-c893-431e-8e6c-b1a5bcc08389 x-openstack-request-id: req-76f929e0-c893-431e-8e6c-b1a5bcc08389 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:00:45.011268 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6cf86612-a721-4032-9b56-b9828fc658cd", "name": "network-vif-deleted", "tag": "a1de646c-827f-41ad-bab9-8457e33db96d", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:00:45.011528 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-76f929e0-c893-431e-8e6c-b1a5bcc08389 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:00:45.011907 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6cf86612-a721-4032-9b56-b9828fc658cd', 'name': 'network-vif-deleted', 'tag': 'a1de646c-827f-41ad-bab9-8457e33db96d', 'status': 'completed', 'code': 200} Jan 05 15:00:45.040184 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8249d996-476a-48ca-bc74-88eba9e93c5b req-6007fdf0-2158-43c9-ab2c-a31ac088a90c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436323 Jan 05 15:00:46.047678 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7dcd2b6a-45ee-41be-9a80-48016a7a810c req-5d21e833-118f-4de4-b36f-6f261784294b tempest-DeleteServersTestJSON-1817369455 tempest-DeleteServersTestJSON-1817369455-project] 10.222.0.30 "GET /v2.0/ports?device_id=6cf86612-a721-4032-9b56-b9828fc658cd HTTP/1.1" status: 200 len: 210 time: 0.0247793 Jan 05 15:00:46.159585 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c65a35-3b26-486d-844a-347241bf4747 req-6e9d4e9e-3d93-4348-b512-5a9782981c88 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:46.161036 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c7c65a35-3b26-486d-844a-347241bf4747 req-6e9d4e9e-3d93-4348-b512-5a9782981c88 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0471854 Jan 05 15:00:46.209549 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c7c65a35-3b26-486d-844a-347241bf4747 req-17def94b-ba97-4300-b1cd-54871616c64d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431335 Jan 05 15:00:47.334604 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 req-4dca11a0-bef3-45a1-af4e-93a5767f4d7e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:47.336921 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 req-4dca11a0-bef3-45a1-af4e-93a5767f4d7e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0556934 Jan 05 15:00:47.392460 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b3dc845f-cd89-40d2-bdd6-35f70ea44d15 req-f37ba39e-6a68-43ba-ae32-911afec13b60 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497456 Jan 05 15:00:47.610218 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a1de646c-827f-41ad-bab9-8457e33db96d no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:00:47.630721 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: a1de646c-827f-41ad-bab9-8457e33db96d {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:00:47.631067 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a1de646c-827f-41ad-bab9-8457e33db96d not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:00:48.524069 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693bc59a-7c1f-4db6-bb38-2983adccfc3f req-2defa50b-8a20-4f82-86cd-a8ee5ee72aaf tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:48.525814 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-693bc59a-7c1f-4db6-bb38-2983adccfc3f req-2defa50b-8a20-4f82-86cd-a8ee5ee72aaf tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0513496 Jan 05 15:00:48.580749 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-693bc59a-7c1f-4db6-bb38-2983adccfc3f req-26f72bba-d9b3-4f80-9a2f-af30715a2c74 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488193 Jan 05 15:00:48.785612 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43512) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:48.828714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_v2 [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] Deleting subnet 851aa76f-ccc4-4997-b93f-8238639e6bfa {{(pid=114654) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:00:48.831800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:48.865137 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:48.874520 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.199253 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43526) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:49.213626 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.241351 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=851aa76f-ccc4-4997-b93f-8238639e6bfa,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:49.245477 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.250961 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-525baad3-4fd7-441c-a551-7be45fe5333a admin admin] 10.222.0.30 "DELETE /v2.0/subnets/851aa76f-ccc4-4997-b93f-8238639e6bfa HTTP/1.1" status: 204 len: 168 time: 0.4643259 Jan 05 15:00:49.255316 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43532) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:49.336871 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-620d432d-01ce-4b2c-b927-382bc657dadf admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.340429 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.453133 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.485550 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.485913 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.486696 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.487031 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > port after_create 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.487358 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > port after_delete 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.487697 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > port after_update 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.488022 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.488343 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.488666 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.489012 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.673095 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.673738 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.673837 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.674107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=114654) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:49.674488 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fca65618-396e-44a0-8e47-55fa90240fd2']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:49.703648 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b req-65d7144e-3fb9-405a-98a6-112c52093496 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:49.704191 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9090f950-f416-4528-99a8-79f83e6339eb') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:49.704191 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9090f950-f416-4528-99a8-79f83e6339eb') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:49.705414 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b req-65d7144e-3fb9-405a-98a6-112c52093496 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0540843 Jan 05 15:00:49.737977 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.742714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-620d432d-01ce-4b2c-b927-382bc657dadf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.758085 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b2d3f0f1-d9a7-40a2-83c8-063accf2c28b req-af96ba8e-cb10-4000-9b29-64d0c2fef757 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471961 Jan 05 15:00:49.761003 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.772108 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Releasing vlan 102 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:00:49.772531 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:00:49.798600 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:00:49.802066 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:00:49.809276 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-620d432d-01ce-4b2c-b927-382bc657dadf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.890661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-620d432d-01ce-4b2c-b927-382bc657dadf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=868c876e-b3ba-4329-ac00-d2f352d6b6f9,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:49.895408 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-620d432d-01ce-4b2c-b927-382bc657dadf admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a58a92493d354f4c93ae830af1fd6fd6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6948833 Jan 05 15:00:49.898657 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43538) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:49.955448 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a119733c-14b9-4465-a542-99d867ece145 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:49.978544 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a119733c-14b9-4465-a542-99d867ece145 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.010775 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.019253 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.022398 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] 10.222.0.30 "DELETE /v2.0/networks/fca65618-396e-44a0-8e47-55fa90240fd2 HTTP/1.1" status: 204 len: 168 time: 0.7659845 Jan 05 15:00:50.031739 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a0aa122-a2df-4e1c-bace-682bdcbe80e2 admin admin] Pushing event deleted for resources: {'Network': ['ID=fca65618-396e-44a0-8e47-55fa90240fd2,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:50.165780 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a119733c-14b9-4465-a542-99d867ece145 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.168406 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a119733c-14b9-4465-a542-99d867ece145 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.169595 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-a119733c-14b9-4465-a542-99d867ece145 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/868c876e-b3ba-4329-ac00-d2f352d6b6f9 HTTP/1.1" status: 204 len: 168 time: 0.2700381 Jan 05 15:00:50.177307 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a119733c-14b9-4465-a542-99d867ece145 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=868c876e-b3ba-4329-ac00-d2f352d6b6f9,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:50.506970 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43554) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:50.546568 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0a0774b0-553a-4d24-b950-4d4b3247612e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=fc623d81b10e491ab3a65d62b99bf7c7&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0379348 Jan 05 15:00:50.548975 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43556) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:50.606015 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5925e052-2b86-4086-ae06-33cfd2d47990 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.627854 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5925e052-2b86-4086-ae06-33cfd2d47990 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.749664 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5925e052-2b86-4086-ae06-33cfd2d47990 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.753186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5925e052-2b86-4086-ae06-33cfd2d47990 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:50.757623 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-5925e052-2b86-4086-ae06-33cfd2d47990 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5c9dde3c-7e40-4c8c-93ef-70084a1cebf0 HTTP/1.1" status: 204 len: 168 time: 0.2076528 Jan 05 15:00:50.766166 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5925e052-2b86-4086-ae06-33cfd2d47990 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c9dde3c-7e40-4c8c-93ef-70084a1cebf0,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:50.880288 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4553525-b1f5-460b-8e0c-310e8f231ef6 req-3809b832-61b9-4574-ac42-26c96f15a519 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:50.881830 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d4553525-b1f5-460b-8e0c-310e8f231ef6 req-3809b832-61b9-4574-ac42-26c96f15a519 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0517414 Jan 05 15:00:50.936108 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d4553525-b1f5-460b-8e0c-310e8f231ef6 req-2362b1ff-2a48-46b8-bbd8-aa9e384f0ee5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460174 Jan 05 15:00:51.884389 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43618) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:51.977330 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1582881396-network', 'tenant_id': '18f9c22e3f1946ef85a79918829056ae'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:52.098737 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Made reservation on behalf of 18f9c22e3f1946ef85a79918829056ae for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:00:52.101191 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.110400 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.184758 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.298800 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.319225 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 124} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:00:52.334299 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2e207d6-dc3a-4c5c-b407-a5823cf17ddf,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:52.337313 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.337571 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Added segment 1e1df5e8-2770-4198-b4ae-75d07c475004 of type vlan for network 73af692c-fd69-41c4-90a2-c8abb27d0f8a Jan 05 15:00:52.380743 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.482037 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.486368 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:52.486368 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.547142 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] Pushing event updated for resources: {'Network': ['ID=73af692c-fd69-41c4-90a2-c8abb27d0f8a,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:52.557998 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 73af692c-fd69-41c4-90a2-c8abb27d0f8a details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:00:52.594032 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-95af750a-6d4c-483e-ad32-003c09034381 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.7084346 Jan 05 15:00:52.596696 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43636) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:52.601598 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Request body: {'subnet': {'network_id': '73af692c-fd69-41c4-90a2-c8abb27d0f8a', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1582881396-subnet', 'tenant_id': '18f9c22e3f1946ef85a79918829056ae', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:52.719768 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Made reservation on behalf of 18f9c22e3f1946ef85a79918829056ae for: {'subnet': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:00:52.722225 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Publish callbacks [] for subnet, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:52.956617 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:53.013889 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Pushing event updated for resources: {'Subnet': ['ID=7cdd077c-2688-47d3-819d-5c622ad5c873,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:53.028137 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Checking segment: {'id': '1e1df5e8-2770-4198-b4ae-75d07c475004', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '73af692c-fd69-41c4-90a2-c8abb27d0f8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:00:53.028509 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Network hostable DHCP agents. Network: 73af692c-fd69-41c4-90a2-c8abb27d0f8a, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114655) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:00:53.205517 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Network 73af692c-fd69-41c4-90a2-c8abb27d0f8a is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114655) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:00:53.353586 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 73af692c-fd69-41c4-90a2-c8abb27d0f8a) {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:00:53.357995 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:53.359180 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:53.364550 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-063f9213-acd8-40be-b4a5-cce34351c246 None None] Network 73af692c-fd69-41c4-90a2-c8abb27d0f8a requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:00:53.462482 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc70e0b2-36e5-40ef-94b1-85eab573b467 None None] Network 73af692c-fd69-41c4-90a2-c8abb27d0f8a requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:00:53.497141 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1f28a269-3e3a-4576-b379-f12645d7b50c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.8992627 Jan 05 15:00:54.225916 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5fd256-1634-4c3b-9aca-07460120b3d5 req-9f015f13-fd16-4968-8a36-1a549515cbd2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:54.227365 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1e5fd256-1634-4c3b-9aca-07460120b3d5 req-9f015f13-fd16-4968-8a36-1a549515cbd2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0487325 Jan 05 15:00:54.274623 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1e5fd256-1634-4c3b-9aca-07460120b3d5 req-d39ffd34-24b4-4418-acb1-e87217d401c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416088 Jan 05 15:00:54.386725 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43674) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:54.392139 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1466400706-network', 'tenant_id': '61aeb98b59034b41b0749332052760c7'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:54.487103 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Made reservation on behalf of 61aeb98b59034b41b0749332052760c7 for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:00:54.489488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.497819 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.576713 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.653251 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.677922 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 130} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:00:54.686293 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cda2e77-5842-4aa4-9c8b-1c63453c5643,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:54.692041 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.692434 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Added segment 5298fc24-06e0-4734-ae2c-0ca6350bd844 of type vlan for network d8588f0b-1ca6-426d-9d0b-ed01873682b5 Jan 05 15:00:54.732510 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.867902 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.868881 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:54.869769 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:54.929205 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] Pushing event updated for resources: {'Network': ['ID=d8588f0b-1ca6-426d-9d0b-ed01873682b5,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:54.951450 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network d8588f0b-1ca6-426d-9d0b-ed01873682b5 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:00:55.022720 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-973e9cc8-e1ba-45d3-b61f-55d6df9c5449 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.6348164 Jan 05 15:00:55.025566 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43692) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:55.030843 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Request body: {'subnet': {'network_id': 'd8588f0b-1ca6-426d-9d0b-ed01873682b5', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1466400706-subnet', 'tenant_id': '61aeb98b59034b41b0749332052760c7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:00:55.253026 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Made reservation on behalf of 61aeb98b59034b41b0749332052760c7 for: {'subnet': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:00:55.255464 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Publish callbacks [] for subnet, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:55.418785 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 req-74660e59-b6c2-4f82-99b1-31f8dd87763e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:55.420404 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 req-74660e59-b6c2-4f82-99b1-31f8dd87763e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0677857 Jan 05 15:00:55.478358 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ffe7b38e-47fc-40ab-b89d-5f7f418b5e55 req-9092f650-c9e2-4ca7-a009-11dc31a866fe tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514283 Jan 05 15:00:55.531752 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:55.595073 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Pushing event updated for resources: {'Subnet': ['ID=f42b1037-6ed3-45c0-812c-1f2860e830d8,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:55.602171 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Checking segment: {'id': '5298fc24-06e0-4734-ae2c-0ca6350bd844', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'd8588f0b-1ca6-426d-9d0b-ed01873682b5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:00:55.602528 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Network hostable DHCP agents. Network: d8588f0b-1ca6-426d-9d0b-ed01873682b5, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114655) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:00:55.710309 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Network d8588f0b-1ca6-426d-9d0b-ed01873682b5 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114655) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:00:55.813181 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, d8588f0b-1ca6-426d-9d0b-ed01873682b5) {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:00:55.817472 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:55.825680 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:55.826357 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4e82d98-839c-4122-bd56-3ce267b39838 None None] Network d8588f0b-1ca6-426d-9d0b-ed01873682b5 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:00:55.918245 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-977b55bf-847f-48ba-9beb-22c4aaecf59b None None] Network d8588f0b-1ca6-426d-9d0b-ed01873682b5 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:00:56.013324 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-91523dbd-b80d-41fd-90e6-d46aa30e91eb admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.9865572 Jan 05 15:00:56.122547 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43734) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:56.166499 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] Deleting subnet 7cdd077c-2688-47d3-819d-5c622ad5c873 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:00:56.169605 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.208096 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.217391 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.328566 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.359363 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7cdd077c-2688-47d3-819d-5c622ad5c873,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:56.363254 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.370491 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-42b096f9-c0de-4fa7-b7a1-933f334d7afe admin admin] 10.222.0.30 "DELETE /v2.0/subnets/7cdd077c-2688-47d3-819d-5c622ad5c873 HTTP/1.1" status: 204 len: 168 time: 0.2429495 Jan 05 15:00:56.370607 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43742) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:56.437601 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.520183 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.541188 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['73af692c-fd69-41c4-90a2-c8abb27d0f8a']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:56.552085 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1e1df5e8-2770-4198-b4ae-75d07c475004') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:56.552448 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1e1df5e8-2770-4198-b4ae-75d07c475004') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:56.564530 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.580681 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.591940 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Releasing vlan 124 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:00:56.592335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:00:56.594240 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:00:56.606054 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85227f11-56ce-464e-8827-2d433060018e req-8e184fb9-de02-4cae-900c-02e7ff4b3d10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:56.606637 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-85227f11-56ce-464e-8827-2d433060018e req-8e184fb9-de02-4cae-900c-02e7ff4b3d10 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0531495 Jan 05 15:00:56.657263 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-85227f11-56ce-464e-8827-2d433060018e req-e1975ecd-4cad-44b4-a42a-6771b09f092c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444195 Jan 05 15:00:56.750823 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.756348 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.760957 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] 10.222.0.30 "DELETE /v2.0/networks/73af692c-fd69-41c4-90a2-c8abb27d0f8a HTTP/1.1" status: 204 len: 168 time: 0.3903883 Jan 05 15:00:56.763815 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43762) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:56.779167 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2252b8de-09dd-40c4-9f9b-2e07d1e5b025 admin admin] Pushing event deleted for resources: {'Network': ['ID=73af692c-fd69-41c4-90a2-c8abb27d0f8a,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:56.808026 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] Deleting subnet f42b1037-6ed3-45c0-812c-1f2860e830d8 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:00:56.811174 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.848235 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:56.853806 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.059293 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.083596 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f42b1037-6ed3-45c0-812c-1f2860e830d8,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:57.088626 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.096271 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-04440342-5c70-4ab4-b57f-33e2d5974db8 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/f42b1037-6ed3-45c0-812c-1f2860e830d8 HTTP/1.1" status: 204 len: 168 time: 0.3270125 Jan 05 15:00:57.096271 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43766) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:57.168114 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.250240 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.270317 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > segment before_delete 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.270660 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.271453 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.271783 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > port after_create 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.272105 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > port after_delete 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.272439 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > port after_update 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.272758 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > segment after_delete 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.273092 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.273411 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.273747 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet after_update 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.340467 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.341154 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.341154 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet before_create 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.341402 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Subscribe: > subnet before_update 55550000 {{(pid=114655) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jan 05 15:00:57.341779 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d8588f0b-1ca6-426d-9d0b-ed01873682b5']}} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:57.359513 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5298fc24-06e0-4734-ae2c-0ca6350bd844') {'for_net_delete': True} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:57.359889 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5298fc24-06e0-4734-ae2c-0ca6350bd844') {} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:00:57.375579 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4701328'] for segment, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.400020 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.408935 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Releasing vlan 130 on physical network physnet1 to pool {{(pid=114655) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:00:57.409271 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4698958'] for segment, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: from cryptography.utils import int_from_bytes Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: from cryptography.utils import int_from_bytes Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.413239 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: warnings.warn(msg) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: Traceback (most recent call last): Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: timer() Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: cb(*args, **kw) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: return func(*args, **kwargs) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: self._notify() Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: self.callback(batched_events) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: event.method(event) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: return f(self, *a, **k) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: return self._get(url).json() Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: return self.request(url, 'GET', **kwargs) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:00:57.415782 dv-cinder-master-3-iscsi neutron-server[114655]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:00:57.582252 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.608040 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:57.613883 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] 10.222.0.30 "DELETE /v2.0/networks/d8588f0b-1ca6-426d-9d0b-ed01873682b5 HTTP/1.1" status: 204 len: 168 time: 0.5179763 Jan 05 15:00:57.618759 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb355e8-b688-4516-850c-eac8460eabbc admin admin] Pushing event deleted for resources: {'Network': ['ID=d8588f0b-1ca6-426d-9d0b-ed01873682b5,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:57.785943 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-913fa177-5e5f-41f5-9c78-2b9141e55147 req-64281e53-3f21-48c1-bb68-d82efbb1aa96 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:57.785943 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-913fa177-5e5f-41f5-9c78-2b9141e55147 req-64281e53-3f21-48c1-bb68-d82efbb1aa96 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0575283 Jan 05 15:00:57.831959 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-913fa177-5e5f-41f5-9c78-2b9141e55147 req-f66b60cc-e8d1-45c2-bdb8-34f061ffb4a6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408759 Jan 05 15:00:58.300303 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43798) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:58.316346 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-24132386-e9d3-4283-9644-28b0ba9d0950 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:58.340263 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-63ffdbf0-cecf-4358-8b52-ac80743f9f3c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=18f9c22e3f1946ef85a79918829056ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0387945 Jan 05 15:00:58.342768 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43800) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:58.387908 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c25890e-0e02-4423-a5ce-2830dd4d8c80 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:58.412278 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c25890e-0e02-4423-a5ce-2830dd4d8c80 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:58.525244 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c25890e-0e02-4423-a5ce-2830dd4d8c80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:58.527862 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c25890e-0e02-4423-a5ce-2830dd4d8c80 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:58.531354 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1c25890e-0e02-4423-a5ce-2830dd4d8c80 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a2e207d6-dc3a-4c5c-b407-a5823cf17ddf HTTP/1.1" status: 204 len: 168 time: 0.1853607 Jan 05 15:00:58.538888 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c25890e-0e02-4423-a5ce-2830dd4d8c80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2e207d6-dc3a-4c5c-b407-a5823cf17ddf,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:00:58.946238 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ee16e3-065c-40a3-9398-61d99a5b868b req-6a87c35f-a806-4de5-86ea-64d497212480 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:00:58.947657 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f9ee16e3-065c-40a3-9398-61d99a5b868b req-6a87c35f-a806-4de5-86ea-64d497212480 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0476489 Jan 05 15:00:58.994125 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f9ee16e3-065c-40a3-9398-61d99a5b868b req-b3e84e1c-0aa2-43bf-ae55-07b03d9e81ba tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403342 Jan 05 15:00:59.355327 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43828) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:59.393974 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-0f327a8b-f034-48e6-8d72-0f2526456ca7 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=61aeb98b59034b41b0749332052760c7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375190 Jan 05 15:00:59.406129 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43830) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:00:59.456877 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f2a5452c-2a29-4b9a-8cd6-df2fd6a22be9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:59.482821 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f2a5452c-2a29-4b9a-8cd6-df2fd6a22be9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:59.584812 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f2a5452c-2a29-4b9a-8cd6-df2fd6a22be9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:59.587850 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f2a5452c-2a29-4b9a-8cd6-df2fd6a22be9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:00:59.589581 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f2a5452c-2a29-4b9a-8cd6-df2fd6a22be9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5cda2e77-5842-4aa4-9c8b-1c63453c5643 HTTP/1.1" status: 204 len: 168 time: 0.1823394 Jan 05 15:00:59.600499 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a5452c-2a29-4b9a-8cd6-df2fd6a22be9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cda2e77-5842-4aa4-9c8b-1c63453c5643,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:00.119065 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84735d23-bd00-41d7-a55e-f3a1754c499e req-e1a1235d-0ead-4aad-9e3c-f363198a2eca tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:00.120577 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-84735d23-bd00-41d7-a55e-f3a1754c499e req-e1a1235d-0ead-4aad-9e3c-f363198a2eca tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0546968 Jan 05 15:01:00.178691 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-84735d23-bd00-41d7-a55e-f3a1754c499e req-d53a00b9-baae-4bc1-a753-5e0c975c54b7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513518 Jan 05 15:01:00.464827 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6cc64b77-5bcc-4f6f-a10e-1fa85792cab7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:00.674637 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 43888) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:00.883413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-724f2815-5c01-432a-904b-494e2fcb57af req-3d0c5b2b-a989-4b54-b8ce-a91e199351d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:00.885086 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-724f2815-5c01-432a-904b-494e2fcb57af req-3d0c5b2b-a989-4b54-b8ce-a91e199351d1 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 1099 time: 0.0580854 Jan 05 15:01:00.928331 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6c48432c-1a7a-4dfd-99f3-0585c44a05b8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:00.992873 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-724f2815-5c01-432a-904b-494e2fcb57af req-608fa697-c0f1-45c4-b5c8-8e9395f17e9b service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773728 Jan 05 15:01:01.029435 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6c48432c-1a7a-4dfd-99f3-0585c44a05b8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:01.105388 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6c48432c-1a7a-4dfd-99f3-0585c44a05b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:01.143498 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-6c48432c-1a7a-4dfd-99f3-0585c44a05b8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b9b647a359ef4133b4a04e6309bfcf66&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4676135 Jan 05 15:01:01.145388 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c48432c-1a7a-4dfd-99f3-0585c44a05b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c740ba8-27b9-4ae5-823b-0382f188e6db,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:01.146126 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43910) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:01.214223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66a5e435-203f-4041-9b40-851969cac5a3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:01.239794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66a5e435-203f-4041-9b40-851969cac5a3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:01.314899 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 req-e1fb79b6-a380-487a-b504-496253872489 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:01.316384 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 req-e1fb79b6-a380-487a-b504-496253872489 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0556669 Jan 05 15:01:01.368612 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c6bc194b-fd00-4e70-bc71-f15bbadb4c50 req-1336a7b6-3ce6-4960-b8ba-084fed319716 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467091 Jan 05 15:01:01.404833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66a5e435-203f-4041-9b40-851969cac5a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:01.407977 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66a5e435-203f-4041-9b40-851969cac5a3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:01.409133 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-66a5e435-203f-4041-9b40-851969cac5a3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0c740ba8-27b9-4ae5-823b-0382f188e6db HTTP/1.1" status: 204 len: 168 time: 0.2620194 Jan 05 15:01:01.416783 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66a5e435-203f-4041-9b40-851969cac5a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c740ba8-27b9-4ae5-823b-0382f188e6db,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:01.856883 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.147798 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43958) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:02.168762 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0f9c66ed-36c3-474d-8aeb-20c353be1be0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.249048 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0f9c66ed-36c3-474d-8aeb-20c353be1be0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.319309 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0f9c66ed-36c3-474d-8aeb-20c353be1be0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.357422 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f9c66ed-36c3-474d-8aeb-20c353be1be0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0ea68f1-5620-4954-b97a-906e3a21b643,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:02.362366 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0f9c66ed-36c3-474d-8aeb-20c353be1be0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=eac26a94175d43c6af67bb9748275a55&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2128899 Jan 05 15:01:02.364974 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 43966) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:02.419624 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1b79d789-c135-4d68-a8a9-ed44f4ca5322 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.443081 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1b79d789-c135-4d68-a8a9-ed44f4ca5322 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.517937 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641637f5-7a16-46ab-b919-4c39d8fbcd16 req-1e1a77a1-042c-4d8d-affc-30e67901f8a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:02.519572 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-641637f5-7a16-46ab-b919-4c39d8fbcd16 req-1e1a77a1-042c-4d8d-affc-30e67901f8a5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0703797 Jan 05 15:01:02.580250 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-641637f5-7a16-46ab-b919-4c39d8fbcd16 req-47545ed5-ed7d-430d-b8b4-c9927152ebd4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548465 Jan 05 15:01:02.607597 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1b79d789-c135-4d68-a8a9-ed44f4ca5322 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.611315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1b79d789-c135-4d68-a8a9-ed44f4ca5322 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:02.612427 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-1b79d789-c135-4d68-a8a9-ed44f4ca5322 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a0ea68f1-5620-4954-b97a-906e3a21b643 HTTP/1.1" status: 204 len: 168 time: 0.2464693 Jan 05 15:01:02.620432 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b79d789-c135-4d68-a8a9-ed44f4ca5322 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0ea68f1-5620-4954-b97a-906e3a21b643,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:02.715349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:03.460775 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44004) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:03.500733 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:03.574450 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-10b67b72-d4f2-42c4-94f1-3641f67b31ee admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:03.653051 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-10b67b72-d4f2-42c4-94f1-3641f67b31ee admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:03.695954 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b req-14020ac8-5d6f-4d50-97a8-810fd3296afd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:03.697486 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b req-14020ac8-5d6f-4d50-97a8-810fd3296afd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.0466692 Jan 05 15:01:03.724969 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-10b67b72-d4f2-42c4-94f1-3641f67b31ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:03.751010 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d98c6c0f-797b-4d42-9a2d-6b1e346b4b5b req-ec67ce57-05ba-4bb3-9535-f886fe253d43 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449507 Jan 05 15:01:03.768095 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-10b67b72-d4f2-42c4-94f1-3641f67b31ee admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2e549d08f1824c45a9dea7b2e6e88c6a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3062122 Jan 05 15:01:03.769206 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b67b72-d4f2-42c4-94f1-3641f67b31ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e07988be-1ecc-4d3f-8d58-0f212d4194a7,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:03.771298 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44022) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:03.832791 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-505a4890-f1b6-4fb0-99b2-1e91f43bf7f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:03.863776 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-505a4890-f1b6-4fb0-99b2-1e91f43bf7f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:03.896449 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38ecab8-1d5f-4efd-9b5c-49e643397414 req-9525864e-67dd-4bfb-a1c3-fd488c09af86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:03.904559 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f38ecab8-1d5f-4efd-9b5c-49e643397414 req-9525864e-67dd-4bfb-a1c3-fd488c09af86 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0633891 Jan 05 15:01:03.955822 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f38ecab8-1d5f-4efd-9b5c-49e643397414 req-30c5ade0-47ac-4da1-8aca-8f2cd73a3948 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503020 Jan 05 15:01:04.139134 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-505a4890-f1b6-4fb0-99b2-1e91f43bf7f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:04.142045 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-505a4890-f1b6-4fb0-99b2-1e91f43bf7f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:04.143218 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-505a4890-f1b6-4fb0-99b2-1e91f43bf7f9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e07988be-1ecc-4d3f-8d58-0f212d4194a7 HTTP/1.1" status: 204 len: 168 time: 0.3706365 Jan 05 15:01:04.150799 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505a4890-f1b6-4fb0-99b2-1e91f43bf7f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e07988be-1ecc-4d3f-8d58-0f212d4194a7,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:04.473436 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:04.908801 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44062) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:04.927441 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-13e0c288-913d-4431-a895-293b997e9d2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.012339 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-13e0c288-913d-4431-a895-293b997e9d2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.167372 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-13e0c288-913d-4431-a895-293b997e9d2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.205733 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e0c288-913d-4431-a895-293b997e9d2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=599757dd-38d6-43a2-8d66-997e2a51d9be,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:05.213731 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44074) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:05.214122 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-13e0c288-913d-4431-a895-293b997e9d2f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b45d2f7e2a94435d959a10458af476a6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3033242 Jan 05 15:01:05.268722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cc39b789-9f0a-496d-bafd-d893718a86dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.289856 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cc39b789-9f0a-496d-bafd-d893718a86dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.413396 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cc39b789-9f0a-496d-bafd-d893718a86dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.416005 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cc39b789-9f0a-496d-bafd-d893718a86dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.417164 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-cc39b789-9f0a-496d-bafd-d893718a86dc admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/599757dd-38d6-43a2-8d66-997e2a51d9be HTTP/1.1" status: 204 len: 168 time: 0.2023208 Jan 05 15:01:05.424545 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc39b789-9f0a-496d-bafd-d893718a86dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=599757dd-38d6-43a2-8d66-997e2a51d9be,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:05.679746 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44086) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:05.796977 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-49443e64-8122-4245-9653-cde3d5f76e0d admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.869154 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-49443e64-8122-4245-9653-cde3d5f76e0d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.955928 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-49443e64-8122-4245-9653-cde3d5f76e0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:05.994936 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-49443e64-8122-4245-9653-cde3d5f76e0d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6ebbbd286498435ea74b69f256780fb1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3140004 Jan 05 15:01:05.995825 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49443e64-8122-4245-9653-cde3d5f76e0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0f45487-6249-4ae5-9778-0bfe6e525c03,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:05.997620 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44100) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:06.056221 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82536a0-0792-4566-8574-9c2d101dca48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.077585 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82536a0-0792-4566-8574-9c2d101dca48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.135921 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44102) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:06.149306 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-dda7fa0c-f07b-4b7f-92b5-6d3987da8ed7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.224909 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82536a0-0792-4566-8574-9c2d101dca48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.227480 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82536a0-0792-4566-8574-9c2d101dca48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.228724 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f82536a0-0792-4566-8574-9c2d101dca48 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c0f45487-6249-4ae5-9778-0bfe6e525c03 HTTP/1.1" status: 204 len: 168 time: 0.2300456 Jan 05 15:01:06.238027 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f82536a0-0792-4566-8574-9c2d101dca48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0f45487-6249-4ae5-9778-0bfe6e525c03,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:06.289975 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-dda7fa0c-f07b-4b7f-92b5-6d3987da8ed7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.356146 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-dda7fa0c-f07b-4b7f-92b5-6d3987da8ed7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.394553 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-dda7fa0c-f07b-4b7f-92b5-6d3987da8ed7 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=89da0307929e47cdbf926456d3198b86&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2574456 Jan 05 15:01:06.395318 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dda7fa0c-f07b-4b7f-92b5-6d3987da8ed7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1baccea-2ed2-4eec-9518-d20770c99e23,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:06.397139 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44106) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:06.444084 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985c0e01-76ad-4fb1-a173-12e33a9e159a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.464756 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985c0e01-76ad-4fb1-a173-12e33a9e159a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.607286 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985c0e01-76ad-4fb1-a173-12e33a9e159a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.610481 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985c0e01-76ad-4fb1-a173-12e33a9e159a admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:06.611825 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-985c0e01-76ad-4fb1-a173-12e33a9e159a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a1baccea-2ed2-4eec-9518-d20770c99e23 HTTP/1.1" status: 204 len: 168 time: 0.2136889 Jan 05 15:01:06.621008 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-985c0e01-76ad-4fb1-a173-12e33a9e159a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1baccea-2ed2-4eec-9518-d20770c99e23,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:07.099088 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44124) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:07.112116 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-21db0e82-7abc-4ef6-a57e-1fc7f1b1ebe4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:07.186435 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-21db0e82-7abc-4ef6-a57e-1fc7f1b1ebe4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:07.241413 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-21db0e82-7abc-4ef6-a57e-1fc7f1b1ebe4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:07.279507 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-21db0e82-7abc-4ef6-a57e-1fc7f1b1ebe4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=dc99d4e713d3488f880b028753d48483&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1793454 Jan 05 15:01:07.280572 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21db0e82-7abc-4ef6-a57e-1fc7f1b1ebe4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3d2955e-bb9a-43ca-a7b0-7eb6c80e9e39,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:07.282235 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44130) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:07.329672 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4ea31eab-f76b-4902-883e-fc9a08ccdc40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:07.352746 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4ea31eab-f76b-4902-883e-fc9a08ccdc40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:07.513984 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4ea31eab-f76b-4902-883e-fc9a08ccdc40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:07.517410 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4ea31eab-f76b-4902-883e-fc9a08ccdc40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:07.518547 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-4ea31eab-f76b-4902-883e-fc9a08ccdc40 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f3d2955e-bb9a-43ca-a7b0-7eb6c80e9e39 HTTP/1.1" status: 204 len: 168 time: 0.2353480 Jan 05 15:01:07.634104 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea31eab-f76b-4902-883e-fc9a08ccdc40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3d2955e-bb9a-43ca-a7b0-7eb6c80e9e39,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:08.291934 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44162) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:08.390384 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1415834401-network', 'tenant_id': 'e785ec07120a4184acdbf74f73489ce8'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:01:08.518900 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Made reservation on behalf of e785ec07120a4184acdbf74f73489ce8 for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:01:08.521311 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.530846 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.602646 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.704303 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.731584 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 125} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:01:08.741858 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74d864e5-10ed-40c0-b4fe-005a3392fae4,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:08.749402 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.750070 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Added segment 52b64191-c846-4aa1-bf19-9e627b802773 of type vlan for network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 Jan 05 15:01:08.791666 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.870199 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.871229 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:08.871866 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:08.930877 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] Pushing event updated for resources: {'Network': ['ID=aec55d3c-7bde-4a3f-bf24-eddde8e56c38,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:08.942065 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:01:09.022377 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-64ebe728-2ac8-4d04-96de-dc8f2bb62b90 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.7293787 Jan 05 15:01:09.025301 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44188) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:09.030616 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Request body: {'subnet': {'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1415834401-subnet', 'tenant_id': 'e785ec07120a4184acdbf74f73489ce8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:01:09.139760 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Made reservation on behalf of e785ec07120a4184acdbf74f73489ce8 for: {'subnet': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:01:09.142421 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4267422'] for subnet, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:09.377197 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4701419', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4267372'] for subnet, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:09.432234 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Pushing event updated for resources: {'Subnet': ['ID=381a404c-2b76-4214-b59d-06022483de49,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:09.443064 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Checking segment: {'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:01:09.443171 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Network hostable DHCP agents. Network: aec55d3c-7bde-4a3f-bf24-eddde8e56c38, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114655) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:01:09.584717 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114655) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:01:09.664402 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, aec55d3c-7bde-4a3f-bf24-eddde8e56c38) {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:01:09.668504 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:09.669160 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:09.673785 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-620df59a-1a32-4841-9eaa-ef1384b0a7ce None None] Network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:01:09.775138 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14422d24-b9c2-45e0-a7b6-3dc51515ade1 None None] Network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:01:09.837155 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-825d4135-723a-434a-846d-6215981e7420 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8107820 Jan 05 15:01:12.957950 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 req-31002eae-cbf3-4d9a-b5b6-034d0b6b9eb6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:12.961521 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 req-31002eae-cbf3-4d9a-b5b6-034d0b6b9eb6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0530863 Jan 05 15:01:13.007319 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2dd099ce-0c63-4e42-9c09-8792514d4dc0 req-d9324db0-8856-41b3-b087-cdfaffd10009 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422928 Jan 05 15:01:13.112250 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37696be3-b0bc-438d-a622-068c287ba76a req-8f825d64-e2d5-43f0-af2d-2a3051a0a6f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:13.113711 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37696be3-b0bc-438d-a622-068c287ba76a req-8f825d64-e2d5-43f0-af2d-2a3051a0a6f4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.0399003 Jan 05 15:01:13.204050 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37696be3-b0bc-438d-a622-068c287ba76a req-026082b7-d403-4ec2-a485-173fae15b3d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:13.205540 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37696be3-b0bc-438d-a622-068c287ba76a req-026082b7-d403-4ec2-a485-173fae15b3d4 service neutron] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 920 time: 0.0830302 Jan 05 15:01:13.256012 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37696be3-b0bc-438d-a622-068c287ba76a req-28475975-b7ea-4ee9-950f-027239725a4a service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 217 time: 0.0332417 Jan 05 15:01:13.307897 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37696be3-b0bc-438d-a622-068c287ba76a req-e33b0e34-3ba5-49d3-bcea-6f6e3b95abe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:13.309446 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37696be3-b0bc-438d-a622-068c287ba76a req-e33b0e34-3ba5-49d3-bcea-6f6e3b95abe6 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0439949 Jan 05 15:01:13.338865 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37696be3-b0bc-438d-a622-068c287ba76a req-98455b4e-32bd-4e0d-aa66-702b27646aab service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234935 Jan 05 15:01:13.424737 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37696be3-b0bc-438d-a622-068c287ba76a req-a52e7678-440f-4142-80f0-3adb885805e3 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798929 Jan 05 15:01:13.518442 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37696be3-b0bc-438d-a622-068c287ba76a req-2b6eb059-5cea-469e-ba13-4a2530989265 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843766 Jan 05 15:01:14.093348 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-dc6bb962-7e90-49b5-9f5a-a775457f1bf7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:14.094816 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-dc6bb962-7e90-49b5-9f5a-a775457f1bf7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/networks?id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38 HTTP/1.1" status: 200 len: 809 time: 0.1252759 Jan 05 15:01:14.109602 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-958dfa47-e07f-4f73-b0d6-c64159900ccc tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/quotas/e785ec07120a4184acdbf74f73489ce8 HTTP/1.1" status: 200 len: 375 time: 0.0092773 Jan 05 15:01:14.145134 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-ad084d05-8a1f-4a4f-a78b-4443de1f0cfd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=e785ec07120a4184acdbf74f73489ce8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0307183 Jan 05 15:01:14.235569 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7b70ef88-dc44-4464-b9d1-db12b91cfde2 service neutron] 10.222.0.30 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827720 Jan 05 15:01:14.241480 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 req-ed8e35e0-0e55-4b17-91cf-02af368e7801 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:14.243699 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 req-ed8e35e0-0e55-4b17-91cf-02af368e7801 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0550721 Jan 05 15:01:14.294451 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-68ea2aaf-1557-415f-a55a-e1d107feb2f2 req-fe7db534-35e3-45b5-8f06-b73e8d96f7b0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447605 Jan 05 15:01:14.347784 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-8804896a-8bf0-49b1-8c62-37cbdab8a983 service neutron] 10.222.0.30 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1057398 Jan 05 15:01:14.587768 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e47f9ad0-9cc7-41dd-bd15-959dd770f069 req-30e71450-5fcc-4889-8089-be510a47dfb6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 210 time: 0.0248930 Jan 05 15:01:15.426585 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 req-3ff9adba-4221-44dd-8c42-95d4ba310992 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:15.428233 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 req-3ff9adba-4221-44dd-8c42-95d4ba310992 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0518782 Jan 05 15:01:15.476579 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-48385da3-ccc8-4a1b-90b0-c6fc191eccd4 req-85151245-fd87-41fc-9c77-892331284a02 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423484 Jan 05 15:01:15.668689 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1378de1d-8544-4d24-915a-742380bf1bd1 req-3c851005-1202-4322-a1e2-a378693e08fd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 210 time: 0.0245624 Jan 05 15:01:16.598609 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31726154-b19d-44e6-b4d6-0038d6ec0221 req-d1a0ca24-51df-4a16-862d-876cf9cbdfaf tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:16.600122 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-31726154-b19d-44e6-b4d6-0038d6ec0221 req-d1a0ca24-51df-4a16-862d-876cf9cbdfaf tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0551023 Jan 05 15:01:16.651990 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-31726154-b19d-44e6-b4d6-0038d6ec0221 req-1399dc91-5f18-4d6e-b1df-7b6c3cea2133 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456240 Jan 05 15:01:16.762357 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-514f4d5f-11a7-4011-8a11-3ea76a255744 req-99d4637e-a1f2-4242-b087-476134a2fa90 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 210 time: 0.0258353 Jan 05 15:01:17.144118 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44406) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:17.248647 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e1a381e5-6190-4c1f-a5d1-66b1897dcbbc admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.324551 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e1a381e5-6190-4c1f-a5d1-66b1897dcbbc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.436259 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e1a381e5-6190-4c1f-a5d1-66b1897dcbbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.472572 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a381e5-6190-4c1f-a5d1-66b1897dcbbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f2f588f-5737-432c-a46c-65148b4c441a,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:17.476599 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-e1a381e5-6190-4c1f-a5d1-66b1897dcbbc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=8dc0fa7c67174eccbd2eb42b56354626&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3314364 Jan 05 15:01:17.479339 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44420) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:17.546580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1f12a85d-7878-48ce-a517-6977af34e6bb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.584380 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1f12a85d-7878-48ce-a517-6977af34e6bb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.598903 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-123f8e9f-39e7-4105-924c-8ae3dba8e47b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:17.600370 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-123f8e9f-39e7-4105-924c-8ae3dba8e47b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "GET /v2.0/networks?id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38 HTTP/1.1" status: 200 len: 809 time: 0.1235044 Jan 05 15:01:17.641203 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Request body: {'port': {'device_id': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38', 'admin_state_up': True, 'tenant_id': 'e785ec07120a4184acdbf74f73489ce8'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:01:17.721976 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1f12a85d-7878-48ce-a517-6977af34e6bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.724812 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1f12a85d-7878-48ce-a517-6977af34e6bb admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.726078 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1f12a85d-7878-48ce-a517-6977af34e6bb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2f2f588f-5737-432c-a46c-65148b4c441a HTTP/1.1" status: 204 len: 168 time: 0.2453787 Jan 05 15:01:17.744146 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f12a85d-7878-48ce-a517-6977af34e6bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f2f588f-5737-432c-a46c-65148b4c441a,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:17.798105 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e req-302b4e93-ef4b-416c-9f60-7e8b5541a45d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:17.799724 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e req-302b4e93-ef4b-416c-9f60-7e8b5541a45d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0700030 Jan 05 15:01:17.862358 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ac7eecb5-6aa9-4062-8ff7-90d3a40bb38e req-c27c9288-ba3b-4af3-9f58-b6f454817646 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553412 Jan 05 15:01:17.881313 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2eda2eac-6a60-4296-8dd7-db8267a8c97f req-0f628670-7222-438a-9fcb-614eaf001730 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 210 time: 0.0407310 Jan 05 15:01:17.882024 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Made reservation on behalf of e785ec07120a4184acdbf74f73489ce8 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:01:17.885702 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:17.966353 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:01:18.010966 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44444) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:18.056769 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Allocated IP 172.20.0.8 (aec55d3c-7bde-4a3f-bf24-eddde8e56c38/381a404c-2b76-4214-b59d-06022483de49/1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:01:18.220284 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.239627 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b0b0d13b-baea-4d4b-ac84-c286ca9867ce admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.319866 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b0b0d13b-baea-4d4b-ac84-c286ca9867ce admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.321937 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.375781 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:01:18.380042 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:01:18.386838 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:01:18.390557 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Pushing event updated for resources: {'Port': ['ID=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:18.400247 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b0b0d13b-baea-4d4b-ac84-c286ca9867ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.445569 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-b0b0d13b-baea-4d4b-ac84-c286ca9867ce admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d009b52253b94692a589de2783954ec3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4334369 Jan 05 15:01:18.446948 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b0d13b-baea-4d4b-ac84-c286ca9867ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c528971-d6b7-479e-9c0d-8927be9b5446,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:18.447099 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:18.447619 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.450964 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44464) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:18.502977 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7c65fb33-01a1-4330-ab97-75bb7c1232c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.524420 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7c65fb33-01a1-4330-ab97-75bb7c1232c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.530607 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-7ed90e8c-9ea9-4618-b7a4-26edb04dcbbd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8932886 Jan 05 15:01:18.566469 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Request body: {'port': {'device_id': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:01:18.618107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.641531 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7c65fb33-01a1-4330-ab97-75bb7c1232c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.647814 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7c65fb33-01a1-4330-ab97-75bb7c1232c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.649044 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-7c65fb33-01a1-4330-ab97-75bb7c1232c8 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3c528971-d6b7-479e-9c0d-8927be9b5446 HTTP/1.1" status: 204 len: 168 time: 0.1971540 Jan 05 15:01:18.674570 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c65fb33-01a1-4330-ab97-75bb7c1232c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c528971-d6b7-479e-9c0d-8927be9b5446,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:18.943378 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:01:18.954917 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:18.997095 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Transition to ACTIVE for port object 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:01:19.019449 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa99e63-98d9-47c5-9085-4835075be706 req-d6d571af-ce2a-4414-a4c5-629ad889f9f1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:19.026318 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5aa99e63-98d9-47c5-9085-4835075be706 req-d6d571af-ce2a-4414-a4c5-629ad889f9f1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0746474 Jan 05 15:01:19.028226 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 req-ce9b3854-eee8-41a8-9b36-84e279274024 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:19.033722 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 req-ce9b3854-eee8-41a8-9b36-84e279274024 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 931 time: 0.0678518 Jan 05 15:01:19.086990 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5aa99e63-98d9-47c5-9085-4835075be706 req-ef53f26c-69f9-4e33-a755-aedce3616f1b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593667 Jan 05 15:01:19.099913 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0aaa478d-e388-41a7-be44-2b0b099a5dd5 req-aad5fe54-9874-4a3e-9ffd-68e5a26c8696 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603113 Jan 05 15:01:19.115465 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.167342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Pushing event updated for resources: {'Port': ['ID=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:19.241113 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Attempting to bind port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:01:19.241571 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Attempting to bind port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:01:19.242035 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Attempting to bind port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 on network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:01:19.246499 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 on network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:01:19.246875 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Attempting to bind port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 on network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:01:19.253341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 1, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:01:19.253341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Checking segment: {'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:01:19.253341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Bound using segment: {'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:01:19.253341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Bound port: 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:01:19.253721 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.313873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] For port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:01:19.316698 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] For port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:01:19.390664 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.425718 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:19.426357 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.427940 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] 10.222.0.13 "PUT /v2.0/ports/1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 HTTP/1.1" status: 200 len: 1093 time: 0.8656497 Jan 05 15:01:19.428173 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'tag': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:01:19.430480 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67c5aebe-683b-452a-82be-2887d9deebd5" -d '{"events": [{"name": "network-changed", "server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:01:19.449835 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44492) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:19.474949 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-489ceafa-d57b-4880-98e5-9fd8bc1ed4c3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.478933 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7833048-d17b-4d8a-9f58-806a6ca7ac61 service neutron] Pushing event updated for resources: {'Port': ['ID=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:19.500311 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:01:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d6072b99-d902-4b45-bade-c8f63104493d x-openstack-request-id: req-d6072b99-d902-4b45-bade-c8f63104493d {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:01:19.500627 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:01:19.500880 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d6072b99-d902-4b45-bade-c8f63104493d {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:01:19.501315 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'tag': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12', 'status': 'completed', 'code': 200} Jan 05 15:01:19.592575 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-489ceafa-d57b-4880-98e5-9fd8bc1ed4c3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.605658 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-07ddefbe-560c-4c61-a256-60662b0c17a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:19.607380 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-07ddefbe-560c-4c61-a256-60662b0c17a4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e785ec07120a4184acdbf74f73489ce8&device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 1096 time: 0.0545015 Jan 05 15:01:19.707499 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-489ceafa-d57b-4880-98e5-9fd8bc1ed4c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.734114 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-b202722a-6dbe-4d49-bfa7-25d0ad6c98e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:19.735736 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-b202722a-6dbe-4d49-bfa7-25d0ad6c98e5 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=e785ec07120a4184acdbf74f73489ce8&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0971868 Jan 05 15:01:19.747411 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-489ceafa-d57b-4880-98e5-9fd8bc1ed4c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c253498-54f5-4732-af46-e9ba2b6503ec,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:19.753322 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-489ceafa-d57b-4880-98e5-9fd8bc1ed4c3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ce00aaf3f8244f71a7ed8c17bae354ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3022745 Jan 05 15:01:19.766278 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44506) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:19.882211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6d0ce38b-42a4-4a88-89cc-439a9b080143 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.886623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-a3e2fd16-412b-4a60-bc69-1e4962a06eda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:19.888158 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-67c5aebe-683b-452a-82be-2887d9deebd5 req-a3e2fd16-412b-4a60-bc69-1e4962a06eda service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1455390 Jan 05 15:01:19.909037 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6d0ce38b-42a4-4a88-89cc-439a9b080143 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:19.994372 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c1388485-45f2-4ae1-b811-9d5597f518ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:19.996348 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-c1388485-45f2-4ae1-b811-9d5597f518ed service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e785ec07120a4184acdbf74f73489ce8&device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 1096 time: 0.0389957 Jan 05 15:01:20.049371 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-d170ec3d-e2b6-48ca-9484-c46623250fa1 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 HTTP/1.1" status: 200 len: 217 time: 0.0373819 Jan 05 15:01:20.101275 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-686c4a3a-a204-4e95-b1fa-88a8c25a9608 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:20.102815 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-686c4a3a-a204-4e95-b1fa-88a8c25a9608 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=381a404c-2b76-4214-b59d-06022483de49 HTTP/1.1" status: 200 len: 849 time: 0.0430834 Jan 05 15:01:20.135713 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-d78d8a19-c3bf-4a2a-b1d3-9db66b7a65d4 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262189 Jan 05 15:01:20.237356 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da79d71d-989c-4453-a040-37dbcd3f75c4 req-5f891170-99c3-4b9f-808f-c70cd9940482 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:20.239057 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-da79d71d-989c-4453-a040-37dbcd3f75c4 req-5f891170-99c3-4b9f-808f-c70cd9940482 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 943 time: 0.0516348 Jan 05 15:01:20.298115 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-da79d71d-989c-4453-a040-37dbcd3f75c4 req-f6ad5d85-1a80-441a-8f80-1a12ed077498 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531602 Jan 05 15:01:20.385259 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44522) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:20.468712 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 req-118b5d41-e6c5-4acb-9c1b-11e2e5b78e72 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:20.470207 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 req-118b5d41-e6c5-4acb-9c1b-11e2e5b78e72 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.3086047 Jan 05 15:01:20.487253 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-a3b3cd0b-e9f9-43ad-bed9-d9e67e80f39c service neutron] 10.222.0.13 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3449645 Jan 05 15:01:20.493002 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-56b9cb57-b523-4e1c-ab55-a70170abd863 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:20.520450 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6d0ce38b-42a4-4a88-89cc-439a9b080143 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:20.522977 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6d0ce38b-42a4-4a88-89cc-439a9b080143 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:20.526586 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-6d0ce38b-42a4-4a88-89cc-439a9b080143 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5c253498-54f5-4732-af46-e9ba2b6503ec HTTP/1.1" status: 204 len: 168 time: 0.7571065 Jan 05 15:01:20.576237 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d0ce38b-42a4-4a88-89cc-439a9b080143 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c253498-54f5-4732-af46-e9ba2b6503ec,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:20.588349 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ac3115c1-1f40-405a-bfa0-d7e19c04aa11 req-7d1ccc4e-80f0-4f9a-8e23-0188d5e8b1ff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1125832 Jan 05 15:01:20.625236 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-56b9cb57-b523-4e1c-ab55-a70170abd863 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:20.631480 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b532bcf0-e8e3-42ad-9d52-79e7e1507b22 req-6517b5de-0ff1-4c74-abf8-402db36e826f service neutron] 10.222.0.13 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1360903 Jan 05 15:01:20.716205 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-56b9cb57-b523-4e1c-ab55-a70170abd863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:20.761977 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56b9cb57-b523-4e1c-ab55-a70170abd863 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f144c8fd-a8a9-42bd-ac3a-3fffecbdbb5e,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:20.767630 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-56b9cb57-b523-4e1c-ab55-a70170abd863 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2c3197b7d48d41c4ae8b136141120bff&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3812919 Jan 05 15:01:20.770434 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44536) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:20.816974 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8507fb3c-4bff-4d16-aca7-737403e2baae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:20.840385 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8507fb3c-4bff-4d16-aca7-737403e2baae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:21.016536 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8507fb3c-4bff-4d16-aca7-737403e2baae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:21.019385 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8507fb3c-4bff-4d16-aca7-737403e2baae admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:21.020500 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-8507fb3c-4bff-4d16-aca7-737403e2baae admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f144c8fd-a8a9-42bd-ac3a-3fffecbdbb5e HTTP/1.1" status: 204 len: 168 time: 0.2491310 Jan 05 15:01:21.028800 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8507fb3c-4bff-4d16-aca7-737403e2baae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f144c8fd-a8a9-42bd-ac3a-3fffecbdbb5e,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:21.418292 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a842db-72ff-470f-9d2d-339d049eed10 req-8783eef7-c5d7-4151-ae6f-54d5317d8b14 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:21.419766 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17a842db-72ff-470f-9d2d-339d049eed10 req-8783eef7-c5d7-4151-ae6f-54d5317d8b14 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 943 time: 0.0481522 Jan 05 15:01:21.481149 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17a842db-72ff-470f-9d2d-339d049eed10 req-9ee7e08c-c5a0-467b-b7a5-73dfb71880cc tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551612 Jan 05 15:01:21.714815 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad req-78fc6e90-783b-4fe0-9829-ad5b1c3374ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:21.716486 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad req-78fc6e90-783b-4fe0-9829-ad5b1c3374ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0589397 Jan 05 15:01:21.768460 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1bc48ed-e8e5-45c5-b123-cc5a50cf2cad req-f0334881-7061-4fe6-a357-7f6e41be2665 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455217 Jan 05 15:01:21.877585 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44588) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:21.898242 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-99e0d929-8c68-4410-9935-e3db989535be admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:21.983219 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-99e0d929-8c68-4410-9935-e3db989535be admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:22.104561 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-99e0d929-8c68-4410-9935-e3db989535be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:22.143237 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-99e0d929-8c68-4410-9935-e3db989535be admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=016f36654d1643969d70d98d42da0f29&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2641246 Jan 05 15:01:22.144090 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e0d929-8c68-4410-9935-e3db989535be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a69910c8-fcd6-49ef-a1ff-31e2506011c5,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:22.145944 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44594) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:22.206044 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-357bb5ae-64b9-43cf-b018-02fed4658027 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:22.226929 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-357bb5ae-64b9-43cf-b018-02fed4658027 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:22.347667 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-357bb5ae-64b9-43cf-b018-02fed4658027 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:22.350321 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-357bb5ae-64b9-43cf-b018-02fed4658027 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:22.351460 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-357bb5ae-64b9-43cf-b018-02fed4658027 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a69910c8-fcd6-49ef-a1ff-31e2506011c5 HTTP/1.1" status: 204 len: 168 time: 0.2044246 Jan 05 15:01:22.359372 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357bb5ae-64b9-43cf-b018-02fed4658027 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a69910c8-fcd6-49ef-a1ff-31e2506011c5,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:22.600923 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce1027eb-7011-47e5-819e-16b52064f07f req-a9540cad-2e2b-447f-a44a-a4a92ae1af89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:22.602481 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ce1027eb-7011-47e5-819e-16b52064f07f req-a9540cad-2e2b-447f-a44a-a4a92ae1af89 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 943 time: 0.0485628 Jan 05 15:01:22.654931 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ce1027eb-7011-47e5-819e-16b52064f07f req-0a70594b-850c-4571-af8e-46c59a3bee4e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459146 Jan 05 15:01:22.898994 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e80ecf9-08ee-46a5-8a87-bc539967b986 req-ca987e27-3bd4-453f-bc35-e94f9fb661fa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:22.901298 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2e80ecf9-08ee-46a5-8a87-bc539967b986 req-ca987e27-3bd4-453f-bc35-e94f9fb661fa tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0518954 Jan 05 15:01:22.950976 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2e80ecf9-08ee-46a5-8a87-bc539967b986 req-3680ee1d-2e67-48ce-8523-8d4921e60746 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441363 Jan 05 15:01:23.709125 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:01:23.798468 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b249d3-e939-4426-bb90-a1b1f68b3095 req-86fa434c-b41f-432c-8173-f4bfc28e4f71 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:23.805636 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e4b249d3-e939-4426-bb90-a1b1f68b3095 req-86fa434c-b41f-432c-8173-f4bfc28e4f71 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 943 time: 0.0840933 Jan 05 15:01:23.870108 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e4b249d3-e939-4426-bb90-a1b1f68b3095 req-9f9d40b9-ee5d-4510-8317-2efbb4891e6c tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630596 Jan 05 15:01:23.935271 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44690) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:23.951854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:23.963556 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12', 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38', 'port_id': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12', 'mac_address': 'fa:16:3e:ed:4e:dd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '381a404c-2b76-4214-b59d-06022483de49', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:01:24.002171 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.015837 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:01:24.043223 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:24.053096 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.079287 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e668432d-ed6e-49eb-a849-9e6f142d7e34 req-664574f8-eda3-4e9f-aed3-341d1fd087be tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:24.080747 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e668432d-ed6e-49eb-a849-9e6f142d7e34 req-664574f8-eda3-4e9f-aed3-341d1fd087be tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0523093 Jan 05 15:01:24.131894 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.133427 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e668432d-ed6e-49eb-a849-9e6f142d7e34 req-5dc8dc2b-1a80-43e8-8084-ae71addd2b1a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469830 Jan 05 15:01:24.202125 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.248913 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:24.252724 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.257177 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.257439 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.257814 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.258160 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.258497 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.261437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.290698 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f93973a-4ce3-48f8-8cba-c51bab376136,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:24.293614 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6b22c92de24249429ee3c736f0fe1447&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3557322 Jan 05 15:01:24.296855 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44704) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:24.298706 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.299084 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.299427 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.299775 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.300104 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.300428 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.300759 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.301095 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.301430 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.301744 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.302065 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.302382 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.302698 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a6800f-1841-480a-bc44-04296b902651 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:24.347044 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e5299b2a-8498-40e0-8b6d-f62c6b0cfc9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.368193 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e5299b2a-8498-40e0-8b6d-f62c6b0cfc9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.499376 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e5299b2a-8498-40e0-8b6d-f62c6b0cfc9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.502214 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e5299b2a-8498-40e0-8b6d-f62c6b0cfc9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:24.503359 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-e5299b2a-8498-40e0-8b6d-f62c6b0cfc9d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6f93973a-4ce3-48f8-8cba-c51bab376136 HTTP/1.1" status: 204 len: 168 time: 0.2054338 Jan 05 15:01:24.512160 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5299b2a-8498-40e0-8b6d-f62c6b0cfc9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f93973a-4ce3-48f8-8cba-c51bab376136,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:24.537088 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:01:24.986960 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de1c303-1ee5-468a-9eea-de660ffac3df req-0a8de051-1dd7-4144-a65e-ab16aa9ad1b0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:24.988457 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7de1c303-1ee5-468a-9eea-de660ffac3df req-0a8de051-1dd7-4144-a65e-ab16aa9ad1b0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 944 time: 0.0532103 Jan 05 15:01:25.062548 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7de1c303-1ee5-468a-9eea-de660ffac3df req-991081da-5930-4fd0-b0b1-fb9b0b5460a6 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657809 Jan 05 15:01:25.064430 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4776f415-e626-4599-b91d-887e6bd364c9 req-15892b1f-a3dd-47d8-bcec-b8c5f6bdf915 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:25.066054 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4776f415-e626-4599-b91d-887e6bd364c9 req-15892b1f-a3dd-47d8-bcec-b8c5f6bdf915 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.0764821 Jan 05 15:01:25.114878 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4776f415-e626-4599-b91d-887e6bd364c9 req-daf13f7f-edc0-474e-93f1-de163b248eec service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420711 Jan 05 15:01:25.263056 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab16e05-3c93-4e6f-8363-85858137e985 req-5e569a27-b666-4e55-bb11-acd27f956bf5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:25.263658 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9ab16e05-3c93-4e6f-8363-85858137e985 req-5e569a27-b666-4e55-bb11-acd27f956bf5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0552411 Jan 05 15:01:25.318792 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9ab16e05-3c93-4e6f-8363-85858137e985 req-daee9295-75ee-44d7-b7f2-e2393fa286f2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449426 Jan 05 15:01:25.343123 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44746) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:25.355905 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.431987 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.526909 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.566246 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=73d2a2e16cb542e39333700e51d0b571&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2213292 Jan 05 15:01:25.566379 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1027114-22d4-4d13-80ac-bb0d66b9f1ae,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:25.568626 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44754) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:25.574074 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.574428 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.574771 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.575114 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.575656 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.575988 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.576770 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.577140 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.577477 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.577806 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.578135 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.578455 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.578774 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06ae2a0b-1b53-4234-83f2-7cbbf54abeb9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:01:25.617678 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-90d03923-f7ae-48c8-a52b-3686efb98c13 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.638065 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-90d03923-f7ae-48c8-a52b-3686efb98c13 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.748206 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:01:25.767288 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-90d03923-f7ae-48c8-a52b-3686efb98c13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.770269 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-90d03923-f7ae-48c8-a52b-3686efb98c13 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.771550 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-90d03923-f7ae-48c8-a52b-3686efb98c13 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e1027114-22d4-4d13-80ac-bb0d66b9f1ae HTTP/1.1" status: 204 len: 168 time: 0.2012672 Jan 05 15:01:25.781696 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d03923-f7ae-48c8-a52b-3686efb98c13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1027114-22d4-4d13-80ac-bb0d66b9f1ae,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:25.904823 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:01:25.909512 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:01:25.911365 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:25.991139 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.020189 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:01:26.022823 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb49dc51-24ac-47f8-9afe-57f33005e59c" -d '{"events": [{"server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "name": "network-vif-plugged", "status": "completed", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:01:26.037815 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:26.076239 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44768) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:26.083602 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:01:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36f71992-fb0a-446c-a9d1-326849c4a36d x-openstack-request-id: req-36f71992-fb0a-446c-a9d1-326849c4a36d {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:01:26.083888 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "name": "network-vif-plugged", "status": "completed", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:01:26.084149 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-36f71992-fb0a-446c-a9d1-326849c4a36d {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:01:26.084546 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12', 'code': 200} Jan 05 15:01:26.142157 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.229481 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:26.230076 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 req-450b82be-63c5-4ba2-a0cc-0cd3d0ee573b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:26.235216 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 req-450b82be-63c5-4ba2-a0cc-0cd3d0ee573b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 945 time: 0.1003089 Jan 05 15:01:26.239497 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d67c21f-c203-4bf2-876a-e368ab8d1bfd admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.303395 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-aa91ce4c-1775-42a8-bc0c-6907cadf0a09 req-09f1d762-bc25-4711-b244-4f28f103f2ea tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670335 Jan 05 15:01:26.329737 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d67c21f-c203-4bf2-876a-e368ab8d1bfd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.418718 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d67c21f-c203-4bf2-876a-e368ab8d1bfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.461912 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d67c21f-c203-4bf2-876a-e368ab8d1bfd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ba3cd20-b143-4e67-8b07-a3977483a622,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:26.495263 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9d67c21f-c203-4bf2-876a-e368ab8d1bfd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=cee6a8a08db34ab4999e8deca906b74d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4149539 Jan 05 15:01:26.495796 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44792) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:26.507015 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2f3a8c-247b-4690-a66f-91ea31107903 req-be3f8b0d-81ba-4847-a45d-d7d978366e59 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:26.508845 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2f2f3a8c-247b-4690-a66f-91ea31107903 req-be3f8b0d-81ba-4847-a45d-d7d978366e59 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.1196125 Jan 05 15:01:26.560034 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e592928-6892-4123-8323-bb7cd2c03fdc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.565565 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2f2f3a8c-247b-4690-a66f-91ea31107903 req-3a71d995-0f88-47f4-af98-830212ac28c2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496216 Jan 05 15:01:26.584928 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e592928-6892-4123-8323-bb7cd2c03fdc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.662839 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0259a9a2-559d-429a-9dd0-b16bdc0d9312 req-ae4c7872-7dbe-4475-9786-76a279bdd76c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:26.664662 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0259a9a2-559d-429a-9dd0-b16bdc0d9312 req-ae4c7872-7dbe-4475-9786-76a279bdd76c service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 1098 time: 0.0497699 Jan 05 15:01:26.713429 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0259a9a2-559d-429a-9dd0-b16bdc0d9312 req-692d8a4f-a99a-4a10-a4aa-660ae837870d service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417197 Jan 05 15:01:26.755636 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e592928-6892-4123-8323-bb7cd2c03fdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.758366 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7e592928-6892-4123-8323-bb7cd2c03fdc admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:26.762264 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7e592928-6892-4123-8323-bb7cd2c03fdc admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6ba3cd20-b143-4e67-8b07-a3977483a622 HTTP/1.1" status: 204 len: 168 time: 0.2626982 Jan 05 15:01:26.768171 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e592928-6892-4123-8323-bb7cd2c03fdc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ba3cd20-b143-4e67-8b07-a3977483a622,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:27.418738 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b6e683-d400-4ee5-8088-180a09b69c64 req-f091721c-c83a-4c80-aab6-fd58326ac198 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:27.420151 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c5b6e683-d400-4ee5-8088-180a09b69c64 req-f091721c-c83a-4c80-aab6-fd58326ac198 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 945 time: 0.0503099 Jan 05 15:01:27.489930 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c5b6e683-d400-4ee5-8088-180a09b69c64 req-03fb1bea-ceba-4149-996f-02057d0fe904 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616655 Jan 05 15:01:27.659776 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 44830) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:27.672987 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e0981eaf-d424-4a4d-af65-dbe800f6c659 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:27.679874 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 req-b8473a5b-28c2-4544-b51c-3e2acd38616e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:27.681356 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 req-b8473a5b-28c2-4544-b51c-3e2acd38616e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0478811 Jan 05 15:01:27.729583 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bca5b1c9-7ddd-42ae-8581-2c5d5321f2e3 req-a54e6581-2adb-48ee-94d5-c14f32d527c7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418396 Jan 05 15:01:27.746687 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e0981eaf-d424-4a4d-af65-dbe800f6c659 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:27.881932 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e0981eaf-d424-4a4d-af65-dbe800f6c659 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:27.890115 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44838) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:27.921198 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0981eaf-d424-4a4d-af65-dbe800f6c659 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6acabae-84f4-4208-b9b6-fbeb738c4002,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:27.926691 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-e0981eaf-d424-4a4d-af65-dbe800f6c659 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9278506791944d4489b47ee7995297a6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2646198 Jan 05 15:01:27.928544 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44842) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:27.986518 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ac43e155-8346-4d33-9d4b-64e2351be17f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.010003 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ac43e155-8346-4d33-9d4b-64e2351be17f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.031297 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-db6d939d-6ec9-4fb4-b4f6-8d1ccd30f6e5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.120445 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-db6d939d-6ec9-4fb4-b4f6-8d1ccd30f6e5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.281987 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-80caa407-c028-4a2c-9fc5-d20150421cf1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.282564 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ac43e155-8346-4d33-9d4b-64e2351be17f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.285037 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ac43e155-8346-4d33-9d4b-64e2351be17f admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.287826 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-ac43e155-8346-4d33-9d4b-64e2351be17f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b6acabae-84f4-4208-b9b6-fbeb738c4002 HTTP/1.1" status: 204 len: 168 time: 0.3577800 Jan 05 15:01:28.291122 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e716f788-1daa-47d3-b23f-4aafe90815af req-6e4e12f4-98c2-494f-9d44-49e036b891bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:28.292653 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e716f788-1daa-47d3-b23f-4aafe90815af req-6e4e12f4-98c2-494f-9d44-49e036b891bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0528333 Jan 05 15:01:28.298488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac43e155-8346-4d33-9d4b-64e2351be17f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6acabae-84f4-4208-b9b6-fbeb738c4002,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:28.313722 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-db6d939d-6ec9-4fb4-b4f6-8d1ccd30f6e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.377458 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db6d939d-6ec9-4fb4-b4f6-8d1ccd30f6e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8e8e0f3-8044-495b-9577-39d59dbbd15a,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:28.380244 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e716f788-1daa-47d3-b23f-4aafe90815af req-db1f0a3d-c964-4a1a-be05-d39fd207eccb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814550 Jan 05 15:01:28.382039 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-db6d939d-6ec9-4fb4-b4f6-8d1ccd30f6e5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a487c7af07d6446bbccd2bd4e56119bd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4915438 Jan 05 15:01:28.384612 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 44852) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:28.426117 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-1fe9ff3d-860d-43aa-ad2b-7025eed57106 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:28.442672 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-1fe9ff3d-860d-43aa-ad2b-7025eed57106 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.0466592 Jan 05 15:01:28.461158 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-99b92e72-efc1-44ed-a76c-e659206e35d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.486629 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-99b92e72-efc1-44ed-a76c-e659206e35d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.557395 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-d30da3cc-717b-4582-9bf4-669a2de589df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:28.559919 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-d30da3cc-717b-4582-9bf4-669a2de589df service neutron] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 920 time: 0.1205618 Jan 05 15:01:28.605974 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-109eafc3-2515-4677-93f7-a25509ca17f2 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 217 time: 0.0406249 Jan 05 15:01:28.628171 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-99b92e72-efc1-44ed-a76c-e659206e35d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.631080 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-99b92e72-efc1-44ed-a76c-e659206e35d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:28.632300 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-99b92e72-efc1-44ed-a76c-e659206e35d7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d8e8e0f3-8044-495b-9577-39d59dbbd15a HTTP/1.1" status: 204 len: 168 time: 0.2464883 Jan 05 15:01:28.654061 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b92e72-efc1-44ed-a76c-e659206e35d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8e8e0f3-8044-495b-9577-39d59dbbd15a,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:28.667041 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7afde0ee-470d-47b5-b364-d1ff91942c40 req-03c5f26a-adc4-4976-8f2b-a98ea5656371 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:28.668859 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-38c905a2-dfcd-41d3-9d4c-47f8121aa86e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:28.669727 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7afde0ee-470d-47b5-b364-d1ff91942c40 req-03c5f26a-adc4-4976-8f2b-a98ea5656371 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 945 time: 0.1052210 Jan 05 15:01:28.671051 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-38c905a2-dfcd-41d3-9d4c-47f8121aa86e service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0561678 Jan 05 15:01:28.719464 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-e06637ca-47b3-4a5d-afa4-9a6f7c6751d2 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0421183 Jan 05 15:01:28.737573 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7afde0ee-470d-47b5-b364-d1ff91942c40 req-c703b0a4-b709-4813-9aaa-9e9d2eb2ea50 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632765 Jan 05 15:01:28.840151 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-dbf86320-66b8-4acb-ae5b-495c48344903 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1140676 Jan 05 15:01:28.941793 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-488b2642-34e1-465b-bf93-e4f7823fc6dd req-992630bf-18c9-4a9e-9781-93265d36f243 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945847 Jan 05 15:01:29.552204 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3656d46c-f3b0-4181-b852-1b865a6c512b req-7706f488-e5c9-4aa6-aff5-273155e758ac tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:29.554045 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3656d46c-f3b0-4181-b852-1b865a6c512b req-7706f488-e5c9-4aa6-aff5-273155e758ac tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0644739 Jan 05 15:01:29.603133 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3656d46c-f3b0-4181-b852-1b865a6c512b req-fb55cd56-94ea-4c73-bc2e-af794f561c52 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437927 Jan 05 15:01:30.278947 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4668ef72-eb06-4708-be35-30a16b26a5d2 req-59fde6fc-f80d-4c43-afa9-28cb26bff922 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:30.280434 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4668ef72-eb06-4708-be35-30a16b26a5d2 req-59fde6fc-f80d-4c43-afa9-28cb26bff922 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0489006 Jan 05 15:01:30.330376 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4668ef72-eb06-4708-be35-30a16b26a5d2 req-14440f3a-4c00-42e8-a5e7-0464d6d161ca tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442226 Jan 05 15:01:30.427619 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd519d6c-d33e-4b6f-ae48-5afb4c86d8dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:30.716286 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05c8b03-c948-4736-9990-8eb24495511f req-7aae2bed-402f-49d4-aaf8-da126bf3f039 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:30.718244 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e05c8b03-c948-4736-9990-8eb24495511f req-7aae2bed-402f-49d4-aaf8-da126bf3f039 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0467880 Jan 05 15:01:30.772930 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e05c8b03-c948-4736-9990-8eb24495511f req-67cf7d95-93ff-4519-9c2e-9e88480988c0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492110 Jan 05 15:01:31.455611 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 req-fedb824a-60d6-4278-9533-1cd20be55f5f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:31.457083 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 req-fedb824a-60d6-4278-9533-1cd20be55f5f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0528646 Jan 05 15:01:31.515698 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b61cd66a-e61d-4844-9d2e-803717f3b2f5 req-2e0d047f-c0b9-4bcc-82dc-3ef90e22d3e2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530174 Jan 05 15:01:31.801450 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:31.812843 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 req-92ab3e13-cef3-4065-ae1a-6515b45deb62 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:31.814433 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 req-92ab3e13-cef3-4065-ae1a-6515b45deb62 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0511689 Jan 05 15:01:31.905814 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1d96df-e704-48ab-bfc8-0897e328efc3 req-20fe2eb6-7b5f-457f-a939-fb5c25b99b16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:31.907943 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-edc39688-47dc-4c09-a85e-1b87c8cbd5c5 req-2cb2dd5d-8e92-4da4-80f2-f37b10a1c05a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603874 Jan 05 15:01:31.909534 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3f1d96df-e704-48ab-bfc8-0897e328efc3 req-20fe2eb6-7b5f-457f-a939-fb5c25b99b16 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0595112 Jan 05 15:01:31.959135 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3f1d96df-e704-48ab-bfc8-0897e328efc3 req-c040fb65-146d-4e2f-b406-9905fff1e4d8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462153 Jan 05 15:01:32.636523 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a52894c-2948-46fa-a606-4fe51f289bfa req-8add2fd8-8b3b-43f4-96f3-1ac30cdb242c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:32.642381 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3a52894c-2948-46fa-a606-4fe51f289bfa req-8add2fd8-8b3b-43f4-96f3-1ac30cdb242c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0519481 Jan 05 15:01:32.701122 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3a52894c-2948-46fa-a606-4fe51f289bfa req-56a8b98b-9162-474f-85b9-77eec56073bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515213 Jan 05 15:01:32.750612 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:33.033546 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 req-c0c7df84-ce5b-4810-9cf1-1c597369703c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:33.034919 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 req-c0c7df84-ce5b-4810-9cf1-1c597369703c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0540004 Jan 05 15:01:33.084677 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3175a5e6-5ec0-4e91-9bd1-1dd50fbfb5e0 req-aea46a09-80f2-489c-9b2c-609b025748f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442204 Jan 05 15:01:33.209089 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249c57e6-d740-4bf3-bdaf-5b01b4484777 req-8a3b9911-6cfe-4e02-a0de-eb114ffe48a6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:33.210650 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-249c57e6-d740-4bf3-bdaf-5b01b4484777 req-8a3b9911-6cfe-4e02-a0de-eb114ffe48a6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0611286 Jan 05 15:01:33.262901 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 req-aae934b4-dfde-4140-b3de-c27b0c67b227 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:33.265512 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 req-aae934b4-dfde-4140-b3de-c27b0c67b227 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 945 time: 0.0524783 Jan 05 15:01:33.272678 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-249c57e6-d740-4bf3-bdaf-5b01b4484777 req-dd81423a-2e34-4e83-956d-697a551f67c4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552511 Jan 05 15:01:33.332179 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-61aa6a39-4d7e-47d0-bd63-66ced26101a8 req-7559087a-1f56-48e5-910e-f091a61a66c2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599000 Jan 05 15:01:33.482683 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:33.841261 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead req-76ed843a-600e-49c5-9f1b-41be2122c09c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:33.843587 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead req-76ed843a-600e-49c5-9f1b-41be2122c09c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0580614 Jan 05 15:01:33.902528 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1ce60ae5-14fd-4fe7-91e0-a008f67c4ead req-9c40221d-9a16-4f7e-a114-bc427733827e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483916 Jan 05 15:01:33.969490 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-b70469b8-e0fb-431b-994d-2ee55bca1b29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:33.971026 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-b70469b8-e0fb-431b-994d-2ee55bca1b29 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.0470331 Jan 05 15:01:34.085156 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-a0ace9f3-f905-48c3-8675-9f3109ee6699 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:34.086542 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-a0ace9f3-f905-48c3-8675-9f3109ee6699 service neutron] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 920 time: 0.0875425 Jan 05 15:01:34.131438 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-198fed10-06b8-4d58-8395-e39baf218469 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 217 time: 0.0378034 Jan 05 15:01:34.200734 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-e761de71-20c2-4d54-af96-d4e3888ff373 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:34.202227 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-e761de71-20c2-4d54-af96-d4e3888ff373 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0627203 Jan 05 15:01:34.219492 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca32118-8129-42a5-9032-e040d0854380 req-785ba2c5-65d5-4cf9-8c7c-4618ebfa1994 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:34.221003 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3ca32118-8129-42a5-9032-e040d0854380 req-785ba2c5-65d5-4cf9-8c7c-4618ebfa1994 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0615623 Jan 05 15:01:34.254814 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-611333bc-9d05-4bdb-b16c-a1a197a54875 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0357273 Jan 05 15:01:34.290069 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3ca32118-8129-42a5-9032-e040d0854380 req-a9a3fa34-b8a5-423d-b211-c9639e0a0588 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560141 Jan 05 15:01:34.404627 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:34.423496 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-d61b0964-c3c1-4c74-95a2-2f75e9b8cf51 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1588902 Jan 05 15:01:34.461341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2de5b04c-e450-446a-991c-b42b32ac2628 req-eafcbd5b-ae34-4164-9e38-0eaa9c5a7aa0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:34.463194 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2de5b04c-e450-446a-991c-b42b32ac2628 req-eafcbd5b-ae34-4164-9e38-0eaa9c5a7aa0 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0926669 Jan 05 15:01:34.575068 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2de5b04c-e450-446a-991c-b42b32ac2628 req-8d59b4fe-fb31-4235-bbcc-071f83273cde tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1057549 Jan 05 15:01:34.586768 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa00ffd4-d361-4e72-8f2c-6a91f0707541 req-5e4b14c6-64b4-44ad-8427-76d89da6b946 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1541991 Jan 05 15:01:34.671476 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94808a5b-7e81-4834-bcce-8abb43b82c16 req-be711114-1f9b-4075-934b-7cf7ff72ac14 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:34.672949 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-94808a5b-7e81-4834-bcce-8abb43b82c16 req-be711114-1f9b-4075-934b-7cf7ff72ac14 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 945 time: 0.2674971 Jan 05 15:01:34.723501 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-94808a5b-7e81-4834-bcce-8abb43b82c16 req-4848d2a7-083a-4951-b11f-5d41aafa3fe3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443902 Jan 05 15:01:35.024872 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65fae50c-9a57-4dc6-a8de-28110e910982 req-1d99ea20-b1b4-4985-9148-378ba8990ea6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:35.028270 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-65fae50c-9a57-4dc6-a8de-28110e910982 req-1d99ea20-b1b4-4985-9148-378ba8990ea6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0518470 Jan 05 15:01:35.076251 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-65fae50c-9a57-4dc6-a8de-28110e910982 req-351a1ba3-3192-4cd3-b72c-4706b7c0350d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418324 Jan 05 15:01:35.432635 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 req-594d99e6-2720-426c-a7e6-c50b97130e8f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:35.434183 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 req-594d99e6-2720-426c-a7e6-c50b97130e8f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0520244 Jan 05 15:01:35.482735 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-60f5ba97-db03-4520-b0da-e3d0c34b4a15 req-1cf6c812-4064-4e19-82e9-fbbc6729ac35 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420895 Jan 05 15:01:35.522975 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-2ce6210b-04ae-476d-a688-93ab31cad660 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:35.523368 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-2ce6210b-04ae-476d-a688-93ab31cad660 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 945 time: 0.0552282 Jan 05 15:01:35.614873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Deleting port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:01:35.615212 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:35.643615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 45178) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:35.709545 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] For port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:35.709912 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:35.723507 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling delete_port for 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:01:35.793379 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-632e4a27-c5e6-48a9-ba37-9aca7b4715cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:35.879749 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62245efc-90eb-40e4-9781-90e25246eafb req-6e8e796b-8826-4be8-a879-da211523efe1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:35.880019 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-62245efc-90eb-40e4-9781-90e25246eafb req-6e8e796b-8826-4be8-a879-da211523efe1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 945 time: 0.0820746 Jan 05 15:01:35.935497 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-62245efc-90eb-40e4-9781-90e25246eafb req-ea7dd8aa-8bff-447d-b79e-84c00fb7ccfe tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496426 Jan 05 15:01:36.061888 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.087594 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Pushing event deleted for resources: {'Port': ['ID=1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:36.110829 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-632e4a27-c5e6-48a9-ba37-9aca7b4715cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.133676 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] No DVR routers for this DVR port 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:01:36.136805 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.140609 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19279ea8-4cfc-47e2-a179-6f73118388b3 req-0fbd5a8a-4c93-4458-abc4-e9aa714a9ec0 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "DELETE /v2.0/ports/1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 HTTP/1.1" status: 204 len: 173 time: 0.6113312 Jan 05 15:01:36.141088 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'name': 'network-vif-deleted', 'tag': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:01:36.143361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6cd363a6-3702-4af1-ad17-737fc7f16c13" -d '{"events": [{"server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "name": "network-vif-deleted", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:01:36.179369 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:01:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-181992fc-d822-466a-912e-4a4246f71d92 x-openstack-request-id: req-181992fc-d822-466a-912e-4a4246f71d92 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:01:36.179661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c747ca1-458e-4b0c-aa5f-fa911f90280e", "name": "network-vif-deleted", "tag": "1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:01:36.179918 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-181992fc-d822-466a-912e-4a4246f71d92 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:01:36.180318 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c747ca1-458e-4b0c-aa5f-fa911f90280e', 'name': 'network-vif-deleted', 'tag': '1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12', 'status': 'completed', 'code': 200} Jan 05 15:01:36.184494 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-632e4a27-c5e6-48a9-ba37-9aca7b4715cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.240057 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632e4a27-c5e6-48a9-ba37-9aca7b4715cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44a462c5-e23d-44a7-a9d0-1d625317e67f,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:36.245558 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-632e4a27-c5e6-48a9-ba37-9aca7b4715cc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=38de823882b746189a785073b9ce0481&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6006835 Jan 05 15:01:36.247020 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 45190) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:36.256584 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 req-b9061e14-57ea-4ebb-9cdb-d1fc8d77125e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:36.261171 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 req-b9061e14-57ea-4ebb-9cdb-d1fc8d77125e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.1063392 Jan 05 15:01:36.303831 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-742dc670-3d08-400d-9a36-daa0df7b312b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.318434 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a7c30e00-800f-44bd-91a2-7e0cc31a35e6 req-05488e7c-1bc6-4277-84be-cd3c8a5341d8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451603 Jan 05 15:01:36.340281 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-742dc670-3d08-400d-9a36-daa0df7b312b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.432595 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5960518d-bedb-4060-af03-02198816da40 req-173cbb8a-2a7d-4a13-b24e-702db1ad1eff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:36.434102 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5960518d-bedb-4060-af03-02198816da40 req-173cbb8a-2a7d-4a13-b24e-702db1ad1eff tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0579147 Jan 05 15:01:36.482523 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5960518d-bedb-4060-af03-02198816da40 req-1c7516ef-98a6-4731-abe4-13c159aa33f8 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427587 Jan 05 15:01:36.539225 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-742dc670-3d08-400d-9a36-daa0df7b312b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.545524 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-742dc670-3d08-400d-9a36-daa0df7b312b admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:36.545524 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-742dc670-3d08-400d-9a36-daa0df7b312b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/44a462c5-e23d-44a7-a9d0-1d625317e67f HTTP/1.1" status: 204 len: 168 time: 0.2950363 Jan 05 15:01:36.553356 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742dc670-3d08-400d-9a36-daa0df7b312b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44a462c5-e23d-44a7-a9d0-1d625317e67f,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:36.620171 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6e84ed-f781-4b99-82f0-28986f3c9899 req-5c74fed0-401d-4327-9312-513f01e0274a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:36.621371 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0c6e84ed-f781-4b99-82f0-28986f3c9899 req-5c74fed0-401d-4327-9312-513f01e0274a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0621710 Jan 05 15:01:36.678535 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0c6e84ed-f781-4b99-82f0-28986f3c9899 req-538ae50d-208c-4ec4-920b-dd2ace37bc85 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503011 Jan 05 15:01:37.048198 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7e2b4f40-c8e9-4ffc-929c-6e332cc2c6db req-4dbfe84c-5ac3-4bb5-a190-83fcd5fca940 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c747ca1-458e-4b0c-aa5f-fa911f90280e HTTP/1.1" status: 200 len: 210 time: 0.0280075 Jan 05 15:01:37.321795 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 45220) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:37.334824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66138de9-caf2-43af-9142-b1a2512b95b0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:37.451577 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66138de9-caf2-43af-9142-b1a2512b95b0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:37.459392 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c711c9-9683-4011-a196-38a50b3c55ef req-bbe4aff4-51db-49d0-8322-6371c0c7d4ed tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:37.460890 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-71c711c9-9683-4011-a196-38a50b3c55ef req-bbe4aff4-51db-49d0-8322-6371c0c7d4ed tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0757375 Jan 05 15:01:37.515424 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-71c711c9-9683-4011-a196-38a50b3c55ef req-a627356a-7d80-401c-8fa2-46683088cd0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486755 Jan 05 15:01:37.519063 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-66138de9-caf2-43af-9142-b1a2512b95b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:37.562972 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-66138de9-caf2-43af-9142-b1a2512b95b0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1ee5a235c76548639d48b0b23f444ebb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2400091 Jan 05 15:01:37.566052 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66138de9-caf2-43af-9142-b1a2512b95b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3dfe2555-fbf0-4ee2-b5f0-dde47b6848b1,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:37.567833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 45226) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:01:37.620280 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e50cf83e-1896-4c70-bf68-53fa306bf9f5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:37.645664 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e50cf83e-1896-4c70-bf68-53fa306bf9f5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:37.795611 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e50cf83e-1896-4c70-bf68-53fa306bf9f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:37.796842 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29dd7d57-350f-45fc-b1dc-1ebb26897329 req-1ad2438d-8820-4d18-928c-9e936733a379 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:37.798338 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-29dd7d57-350f-45fc-b1dc-1ebb26897329 req-1ad2438d-8820-4d18-928c-9e936733a379 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0487068 Jan 05 15:01:37.798754 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e50cf83e-1896-4c70-bf68-53fa306bf9f5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:37.800041 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-e50cf83e-1896-4c70-bf68-53fa306bf9f5 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3dfe2555-fbf0-4ee2-b5f0-dde47b6848b1 HTTP/1.1" status: 204 len: 168 time: 0.2312517 Jan 05 15:01:37.811426 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:01:37.811946 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50cf83e-1896-4c70-bf68-53fa306bf9f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dfe2555-fbf0-4ee2-b5f0-dde47b6848b1,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:37.838738 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:01:37.839089 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 1dddb5c8-0e30-40d9-b3fb-f5e15aef6b12 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:01:37.854413 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-29dd7d57-350f-45fc-b1dc-1ebb26897329 req-cd10ec81-433f-4aaf-8597-5bc9e1c557fb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498393 Jan 05 15:01:38.380923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56196d76-ace3-43af-845c-24f5a55d987e req-9a015214-5c44-4cf9-bb20-d79c9fe0460e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:38.382440 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-9a015214-5c44-4cf9-bb20-d79c9fe0460e tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/networks?id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38 HTTP/1.1" status: 200 len: 809 time: 0.1041555 Jan 05 15:01:38.397119 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-c0e1bdda-d046-475b-a040-8ab4aefeebbe tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/quotas/e785ec07120a4184acdbf74f73489ce8 HTTP/1.1" status: 200 len: 375 time: 0.0089433 Jan 05 15:01:38.435072 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-37809702-1351-41d5-80fb-7c1909113a24 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=e785ec07120a4184acdbf74f73489ce8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0274274 Jan 05 15:01:38.540184 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-94ae1bb9-9ff8-461f-b636-379ea2d66d00 service neutron] 10.222.0.30 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927923 Jan 05 15:01:38.637263 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-e3106f70-eb1b-451c-9251-553c14d12193 service neutron] 10.222.0.30 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0914450 Jan 05 15:01:38.650965 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6219afb2-94dd-4253-b71f-22ed58b76e63 req-d01bc11a-f42f-4339-9dcd-a837581a2d5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:38.652994 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6219afb2-94dd-4253-b71f-22ed58b76e63 req-d01bc11a-f42f-4339-9dcd-a837581a2d5b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0546939 Jan 05 15:01:38.705495 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6219afb2-94dd-4253-b71f-22ed58b76e63 req-344b289e-40bc-4832-9830-1990ea88129d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470021 Jan 05 15:01:38.988357 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bdd02c5d-e288-4b1a-9019-8d6f61d1cf79 req-9d108023-1732-4b61-9f45-8cc4bbbe6d5b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 210 time: 0.0341699 Jan 05 15:01:39.017578 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c336c26-ec91-4ac0-96c9-de473a090e5b req-f1e525fd-8c54-495d-8059-e548193b1249 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:39.019319 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8c336c26-ec91-4ac0-96c9-de473a090e5b req-f1e525fd-8c54-495d-8059-e548193b1249 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0524070 Jan 05 15:01:39.081909 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8c336c26-ec91-4ac0-96c9-de473a090e5b req-6a50e03e-6884-4b3c-94d6-c575cc81ecf9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554643 Jan 05 15:01:39.827191 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b req-0882bac0-a51f-4611-9568-41b2c24b8ea4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:39.829257 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b req-0882bac0-a51f-4611-9568-41b2c24b8ea4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0514138 Jan 05 15:01:39.875938 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4e116ea6-7f40-4560-9e75-c2cf0e20f76b req-cc974ff5-67bd-487a-b95d-aad3a97d8099 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407617 Jan 05 15:01:40.092448 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a3e3f2fd-7431-4af9-8a00-803539cb83b8 req-f8c49003-44dd-44ff-87ac-df8c27d36b21 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 210 time: 0.0254965 Jan 05 15:01:40.215958 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a187394f-4a90-4e96-9eeb-8773326a037d req-4dc94c44-31bf-4515-85b2-6f1964ecfe30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:40.217508 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a187394f-4a90-4e96-9eeb-8773326a037d req-4dc94c44-31bf-4515-85b2-6f1964ecfe30 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0549374 Jan 05 15:01:40.266922 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a187394f-4a90-4e96-9eeb-8773326a037d req-31a4a687-71a0-4ec8-b41d-17a2da01c4b8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432932 Jan 05 15:01:41.005994 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d2081c4-667c-45b8-848c-a15ab7228cd5 req-3088ea4f-4048-406e-a52a-753f1ac9f4d6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:41.009938 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9d2081c4-667c-45b8-848c-a15ab7228cd5 req-3088ea4f-4048-406e-a52a-753f1ac9f4d6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0584471 Jan 05 15:01:41.058847 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9d2081c4-667c-45b8-848c-a15ab7228cd5 req-8bf0df98-6ef9-4a46-b86a-bb8b6aba6739 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452149 Jan 05 15:01:41.193197 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d7877615-4ac1-4043-9176-ec4d379dfee4 req-8ef3776b-ec95-4fc6-b1c6-d19c61504924 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 210 time: 0.0303731 Jan 05 15:01:41.387666 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce req-94cf56d9-3452-443e-8d28-2d75bd245a06 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:41.389024 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce req-94cf56d9-3452-443e-8d28-2d75bd245a06 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0477874 Jan 05 15:01:41.434346 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f6e433cb-78d4-4d1f-85bd-c2f816af8dce req-a151c3d9-a953-45ce-80f7-c6c608929885 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397670 Jan 05 15:01:41.571166 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56196d76-ace3-43af-845c-24f5a55d987e req-9fc8c008-6e0c-4d56-9849-5f64f9fb6599 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:41.572584 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-9fc8c008-6e0c-4d56-9849-5f64f9fb6599 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "GET /v2.0/networks?id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38 HTTP/1.1" status: 200 len: 809 time: 0.1050248 Jan 05 15:01:41.590971 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Request body: {'port': {'device_id': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38', 'admin_state_up': True, 'tenant_id': 'e785ec07120a4184acdbf74f73489ce8'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:01:41.770319 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Made reservation on behalf of e785ec07120a4184acdbf74f73489ce8 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:01:41.773947 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:41.908519 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Allocated IP 172.20.0.11 (aec55d3c-7bde-4a3f-bf24-eddde8e56c38/381a404c-2b76-4214-b59d-06022483de49/32e7c026-6194-414c-8f67-f9b7c7e9a4d0) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:01:42.054380 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:42.210657 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e199774c-cb64-44e2-9a90-c2c61bc1b466 req-2ea85099-df37-4279-9344-edcafc576449 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:42.212630 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e199774c-cb64-44e2-9a90-c2c61bc1b466 req-2ea85099-df37-4279-9344-edcafc576449 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0493529 Jan 05 15:01:42.213745 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:42.268462 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:01:42.272938 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:01:42.282725 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:01:42.297862 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e199774c-cb64-44e2-9a90-c2c61bc1b466 req-959b9182-8ee2-42f1-a21d-076465929349 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0770371 Jan 05 15:01:42.321008 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Pushing event updated for resources: {'Port': ['ID=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:42.360060 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:42.360671 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:42.383734 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 req-88f43504-8d38-4f44-8357-e9ada437a800 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:42.385313 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 req-88f43504-8d38-4f44-8357-e9ada437a800 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 932 time: 0.0788214 Jan 05 15:01:42.430703 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7dd5ed71-7557-4071-bbbb-7c0cd39c7a26 req-ba6f0d22-e6e0-4332-a0cb-12873b264696 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398254 Jan 05 15:01:42.455414 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-0a70c648-a238-4722-9540-a5f2b886bdb3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8680267 Jan 05 15:01:42.474775 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Request body: {'port': {'device_id': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:01:42.534187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:42.563608 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 req-0e529fdb-1087-4d20-9ded-60fec8216378 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:42.573579 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 req-0e529fdb-1087-4d20-9ded-60fec8216378 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0640428 Jan 05 15:01:42.621503 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6ba4efcd-c223-47cc-a736-4979ddcdbd41 req-beaf6cd5-0db8-4521-9731-05d1ed417dca tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470216 Jan 05 15:01:42.801552 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:01:42.808658 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:42.820600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Transition to ACTIVE for port object 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:01:42.916168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:42.972100 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Pushing event updated for resources: {'Port': ['ID=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:43.038527 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Attempting to bind port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:01:43.038836 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Attempting to bind port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:01:43.039151 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Attempting to bind port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 on network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:01:43.043387 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 on network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:01:43.043711 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Attempting to bind port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 on network aec55d3c-7bde-4a3f-bf24-eddde8e56c38 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:01:43.048925 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 1, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:01:43.049294 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Checking segment: {'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:01:43.049679 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Bound using segment: {'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:01:43.050101 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Bound port: 32e7c026-6194-414c-8f67-f9b7c7e9a4d0, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '52b64191-c846-4aa1-bf19-9e627b802773', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:01:43.050453 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:43.114321 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] For port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:01:43.125093 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] For port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:01:43.234688 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:43.283910 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:43.284530 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:43.285958 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] 10.222.0.13 "PUT /v2.0/ports/32e7c026-6194-414c-8f67-f9b7c7e9a4d0 HTTP/1.1" status: 200 len: 1094 time: 0.8154876 Jan 05 15:01:43.286405 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'tag': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:01:43.288639 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f36758c-8229-4064-918d-ebe505721cb5" -d '{"events": [{"name": "network-changed", "server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:01:43.326931 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:01:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0cddf29a-d295-461c-94f0-2e8466a2401f x-openstack-request-id: req-0cddf29a-d295-461c-94f0-2e8466a2401f {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:01:43.327214 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:01:43.327483 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0cddf29a-d295-461c-94f0-2e8466a2401f {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:01:43.327900 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'tag': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0', 'status': 'completed', 'code': 200} Jan 05 15:01:43.332284 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59163f1b-6144-489b-aae3-d6220563d63d service neutron] Pushing event updated for resources: {'Port': ['ID=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:43.428917 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43cd6160-13de-4055-bbe0-c3193e37d722 req-96138b7f-e467-41cb-a621-794368a57d81 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:43.428917 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-43cd6160-13de-4055-bbe0-c3193e37d722 req-96138b7f-e467-41cb-a621-794368a57d81 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0523069 Jan 05 15:01:43.476105 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-43cd6160-13de-4055-bbe0-c3193e37d722 req-3895ccae-3abe-4184-8b4d-61bf893120bf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416434 Jan 05 15:01:43.555254 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91421d68-38f6-4df0-a0f7-aea8aebdad74 req-79d9deaf-0cca-48c6-9b5a-f2afeead8231 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:43.556725 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-91421d68-38f6-4df0-a0f7-aea8aebdad74 req-79d9deaf-0cca-48c6-9b5a-f2afeead8231 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0519519 Jan 05 15:01:43.602728 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-91421d68-38f6-4df0-a0f7-aea8aebdad74 req-bbcfc321-ab03-40fc-ace8-b19d8f3bc601 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402651 Jan 05 15:01:43.740913 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46026a69-9892-4ff1-a3a4-0562402187ab req-bbe7fbe9-d492-4d69-ba55-d0af6eb5ef1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:43.742912 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-46026a69-9892-4ff1-a3a4-0562402187ab req-bbe7fbe9-d492-4d69-ba55-d0af6eb5ef1b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0551891 Jan 05 15:01:43.792802 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-46026a69-9892-4ff1-a3a4-0562402187ab req-c643ebcd-8b44-4cf0-b0d8-8036b4953858 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437477 Jan 05 15:01:44.602734 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-981ad3ee-f178-4895-937e-1dcf22dcc74a req-841a4cc4-da7d-4220-98e1-dc9a41010607 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:44.604513 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-981ad3ee-f178-4895-937e-1dcf22dcc74a req-841a4cc4-da7d-4220-98e1-dc9a41010607 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0522368 Jan 05 15:01:44.654384 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-981ad3ee-f178-4895-937e-1dcf22dcc74a req-6d5fc7f1-bc87-41a4-9aab-1c679f9e5e47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432291 Jan 05 15:01:44.726622 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654997c6-bef5-4648-9827-bbbe3ccc6b11 req-16dff0ab-ec64-457f-9738-c5ed3c0bdd29 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:44.728095 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-654997c6-bef5-4648-9827-bbbe3ccc6b11 req-16dff0ab-ec64-457f-9738-c5ed3c0bdd29 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0514672 Jan 05 15:01:44.781171 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-654997c6-bef5-4648-9827-bbbe3ccc6b11 req-b452934d-66a9-4563-b175-160c8cd28b55 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465903 Jan 05 15:01:44.903780 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-352da257-1a60-488c-accc-39b354d3c1a7 req-25ebd9e5-2291-469a-9f2e-26ec1bacd906 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:44.905242 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-352da257-1a60-488c-accc-39b354d3c1a7 req-25ebd9e5-2291-469a-9f2e-26ec1bacd906 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0474901 Jan 05 15:01:44.966312 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-352da257-1a60-488c-accc-39b354d3c1a7 req-9579c299-a5d3-4e39-a9cc-d3015600db63 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549517 Jan 05 15:01:45.774868 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 req-7c04c433-5842-424c-aee9-a6e5058df6a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:45.776331 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 req-7c04c433-5842-424c-aee9-a6e5058df6a9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0485139 Jan 05 15:01:45.823295 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-be25f463-fbe0-4a85-a22d-9ff5f9c1bbd4 req-308e24b4-c9a2-4210-85a4-25f586022dd6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409155 Jan 05 15:01:45.892911 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-977f3d34-1a42-4e47-8d91-b2feb2128e94 req-83591b03-aa85-4a31-af4d-f1f51b755810 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:45.894404 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-977f3d34-1a42-4e47-8d91-b2feb2128e94 req-83591b03-aa85-4a31-af4d-f1f51b755810 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0479667 Jan 05 15:01:45.950738 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-977f3d34-1a42-4e47-8d91-b2feb2128e94 req-78ae66ef-dc37-4d0a-bd68-c218c8322f66 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506930 Jan 05 15:01:46.101632 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-246aa409-6f05-467e-b12f-59b6ad0a5aaf req-4132cda1-63fe-4885-a7dd-78eddb297447 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:46.103090 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-246aa409-6f05-467e-b12f-59b6ad0a5aaf req-4132cda1-63fe-4885-a7dd-78eddb297447 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0715127 Jan 05 15:01:46.154409 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-246aa409-6f05-467e-b12f-59b6ad0a5aaf req-8895d922-8242-4d1b-a664-f88615c65bae tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450630 Jan 05 15:01:46.178204 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56196d76-ace3-43af-845c-24f5a55d987e req-3457d929-20a8-4705-9fbd-1a3d344e57ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:46.179694 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-3457d929-20a8-4705-9fbd-1a3d344e57ec service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e785ec07120a4184acdbf74f73489ce8&device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 1097 time: 0.0409412 Jan 05 15:01:46.455379 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-039c440c-2ba8-4fb0-8419-441116cb6f86 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=32e7c026-6194-414c-8f67-f9b7c7e9a4d0 HTTP/1.1" status: 200 len: 217 time: 0.2529213 Jan 05 15:01:46.514837 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56196d76-ace3-43af-845c-24f5a55d987e req-ec626fee-a985-4426-8673-b0a99d9747a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:46.516303 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-ec626fee-a985-4426-8673-b0a99d9747a8 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=381a404c-2b76-4214-b59d-06022483de49 HTTP/1.1" status: 200 len: 849 time: 0.0467758 Jan 05 15:01:46.548199 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-95ecc746-94c1-4b8b-a060-63c935f3bd61 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245950 Jan 05 15:01:46.643076 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-7836c673-c163-4e53-ac90-6dc0e8df4607 service neutron] 10.222.0.13 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833707 Jan 05 15:01:46.736033 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56196d76-ace3-43af-845c-24f5a55d987e req-aeca7e50-85b1-40fe-864f-f876ff489041 service neutron] 10.222.0.13 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849092 Jan 05 15:01:46.942255 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea req-45abb05c-f9f1-4077-b5b3-4aae3d1c8fd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:46.943975 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea req-45abb05c-f9f1-4077-b5b3-4aae3d1c8fd4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0496974 Jan 05 15:01:47.026312 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f36758c-8229-4064-918d-ebe505721cb5 req-d4321f17-1429-4f10-ab46-849c1a0bb07e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:47.027852 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-d4321f17-1429-4f10-ab46-849c1a0bb07e service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e785ec07120a4184acdbf74f73489ce8&device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 1097 time: 0.0715611 Jan 05 15:01:47.032941 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80294e7f-cc1e-482a-9dd5-8c5388abe1ea req-e219c149-dedc-4e96-a1ea-0b4b43f3b48f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0832887 Jan 05 15:01:47.077752 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a13b5e-a815-4e6d-b02b-2e62379c8741 req-03120e57-8e9e-43a8-b594-4817dee6cc36 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:47.079241 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-95a13b5e-a815-4e6d-b02b-2e62379c8741 req-03120e57-8e9e-43a8-b594-4817dee6cc36 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0508466 Jan 05 15:01:47.126528 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f36758c-8229-4064-918d-ebe505721cb5 req-6ffac706-f594-435e-8af3-8353896a742c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:47.128144 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-6ffac706-f594-435e-8af3-8353896a742c service neutron] 10.222.0.13 "GET /v2.0/networks?id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38 HTTP/1.1" status: 200 len: 910 time: 0.0928476 Jan 05 15:01:47.137277 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-95a13b5e-a815-4e6d-b02b-2e62379c8741 req-f4134936-45b2-40b2-8e42-2c220d883342 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515165 Jan 05 15:01:47.175647 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-30fa9b1a-5e42-4675-9a60-85ae16504509 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=32e7c026-6194-414c-8f67-f9b7c7e9a4d0 HTTP/1.1" status: 200 len: 217 time: 0.0399604 Jan 05 15:01:47.234389 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f36758c-8229-4064-918d-ebe505721cb5 req-4f9916e2-98d4-428c-aeb6-7b707e6a5335 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:47.236188 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-4f9916e2-98d4-428c-aeb6-7b707e6a5335 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=381a404c-2b76-4214-b59d-06022483de49 HTTP/1.1" status: 200 len: 849 time: 0.0477803 Jan 05 15:01:47.285800 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-1c8ec9c2-4d41-4f49-a042-dafc26d1310a service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=aec55d3c-7bde-4a3f-bf24-eddde8e56c38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0376570 Jan 05 15:01:47.326654 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751c3675-8b66-4a31-88cd-b0328ca0d52c req-0254e1cc-bb33-4c32-8279-7435a2673bb8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:47.328210 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-751c3675-8b66-4a31-88cd-b0328ca0d52c req-0254e1cc-bb33-4c32-8279-7435a2673bb8 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0886922 Jan 05 15:01:47.425454 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-751c3675-8b66-4a31-88cd-b0328ca0d52c req-4c86267d-c224-4348-8a5d-26d35ef38ad0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0711563 Jan 05 15:01:47.431398 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-a16d31ed-3955-4cae-bbb7-03b91b5d42fc service neutron] 10.222.0.13 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1370292 Jan 05 15:01:47.531697 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f36758c-8229-4064-918d-ebe505721cb5 req-d1d75a69-776c-47cd-bbaa-12954940fb64 service neutron] 10.222.0.13 "GET /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946283 Jan 05 15:01:48.157290 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f req-6e0a23b7-73c9-4296-9911-26ef9df86ace tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:48.158716 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f req-6e0a23b7-73c9-4296-9911-26ef9df86ace tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0539927 Jan 05 15:01:48.209631 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d5e3ffad-7abf-4b57-a4d3-85cf7fad572f req-98454cac-8f32-4a54-9065-9a6d8dd41921 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448854 Jan 05 15:01:48.256835 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f19381-c316-4a09-afe6-5ccd6bea8bae req-db0257da-e9f9-4113-82ba-500a7b9d958c tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:48.258350 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9f19381-c316-4a09-afe6-5ccd6bea8bae req-db0257da-e9f9-4113-82ba-500a7b9d958c tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0494928 Jan 05 15:01:48.305837 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9f19381-c316-4a09-afe6-5ccd6bea8bae req-1674a007-a72c-42fe-8ef4-8ae5eae018c3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414314 Jan 05 15:01:48.546012 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87717609-c64b-44f1-b0ff-ebba93b95099 req-23d76de8-8a2b-4f46-9e26-4aac2bcd00d1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:48.552762 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-87717609-c64b-44f1-b0ff-ebba93b95099 req-23d76de8-8a2b-4f46-9e26-4aac2bcd00d1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0526900 Jan 05 15:01:48.601901 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-87717609-c64b-44f1-b0ff-ebba93b95099 req-41a032b4-a00d-49ef-8fd0-4b7a32647e09 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432508 Jan 05 15:01:48.869188 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38971215-c5f1-40c7-a2b7-b402bf82c902 req-1865e29c-144e-4fbd-926e-f91829b948ef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:48.870879 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-38971215-c5f1-40c7-a2b7-b402bf82c902 req-1865e29c-144e-4fbd-926e-f91829b948ef tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0534599 Jan 05 15:01:48.932961 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-38971215-c5f1-40c7-a2b7-b402bf82c902 req-29cfd3cf-0471-491f-b3c2-42822cf653b1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542397 Jan 05 15:01:49.063500 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec req-21afcfd0-9139-411e-83f7-40ac95094dee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:49.065197 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec req-21afcfd0-9139-411e-83f7-40ac95094dee tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0523891 Jan 05 15:01:49.112520 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fdbdf5df-c6f3-4aab-ad11-f82d8bf7b0ec req-3fddb64c-f41d-4c0f-8f31-a86aa5b50b93 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401411 Jan 05 15:01:49.336175 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abbeadf8-1081-41dd-88b3-a3675b51681c req-9d23a033-54b2-4c13-bb47-4ee401b03247 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:49.337701 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-abbeadf8-1081-41dd-88b3-a3675b51681c req-9d23a033-54b2-4c13-bb47-4ee401b03247 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0518148 Jan 05 15:01:49.387112 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-abbeadf8-1081-41dd-88b3-a3675b51681c req-3eb21f48-de41-4be5-a069-3e7a0298fac7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439034 Jan 05 15:01:49.428897 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 req-f7faf9e0-ca7d-4a86-b8cb-066546bceaec tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:49.430391 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 req-f7faf9e0-ca7d-4a86-b8cb-066546bceaec tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0565023 Jan 05 15:01:49.478499 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-839bdb3e-15e7-4fb3-89af-11f28539b8f6 req-177e4b0f-8a6d-4f0a-b7ba-24e2618a81eb tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426219 Jan 05 15:01:50.055151 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860a8f0f-761c-4a93-a7c5-cc09e825f52f req-524f1bee-efc9-4394-b2af-76937e33c320 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:50.057118 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-860a8f0f-761c-4a93-a7c5-cc09e825f52f req-524f1bee-efc9-4394-b2af-76937e33c320 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0519805 Jan 05 15:01:50.106550 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-860a8f0f-761c-4a93-a7c5-cc09e825f52f req-92059aca-af29-4b75-9054-399c9b246e69 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437376 Jan 05 15:01:50.231051 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a506c71b-215c-43fb-ac27-ef147fce001c req-a2fb930a-0f82-4e5c-a7fa-d9be77170c59 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:50.232501 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a506c71b-215c-43fb-ac27-ef147fce001c req-a2fb930a-0f82-4e5c-a7fa-d9be77170c59 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0491970 Jan 05 15:01:50.278239 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a506c71b-215c-43fb-ac27-ef147fce001c req-a9d84ad3-b5d2-414d-bba7-acf2221df30a tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400813 Jan 05 15:01:50.514525 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 req-4f894a9c-88ed-4c68-88ce-40d68f00b926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:50.515972 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 req-4f894a9c-88ed-4c68-88ce-40d68f00b926 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0516992 Jan 05 15:01:50.562887 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dfb7393c-dda6-4c0e-9b39-09464f0c8477 req-97825f6c-68c0-4eda-95bc-011333331058 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414751 Jan 05 15:01:50.590412 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 req-ea574e5f-6d35-4dfc-a586-7b95a3863544 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:50.591882 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 req-ea574e5f-6d35-4dfc-a586-7b95a3863544 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0481791 Jan 05 15:01:50.637613 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-08ca1d46-40a1-41fe-8e7c-35a6beb816e6 req-4f87bd11-4f27-4696-bec0-cbaae204a3cc tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401740 Jan 05 15:01:51.184344 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:01:51.232383 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5c9681-e5ae-4122-a299-847c5b7cceef req-62002e05-ae75-4b0e-8237-56f9bfe6167a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.233921 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b5c9681-e5ae-4122-a299-847c5b7cceef req-62002e05-ae75-4b0e-8237-56f9bfe6167a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0602722 Jan 05 15:01:51.287755 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:51.299874 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '45483c3c-9f42-4aff-a962-22ff36647afc', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'port_id': '45483c3c-9f42-4aff-a962-22ff36647afc', 'mac_address': 'fa:16:3e:25:44:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:01:51.300983 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-26d4e297-215d-4c5f-840e-e4fafdbf2abb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.302710 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-26d4e297-215d-4c5f-840e-e4fafdbf2abb service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.0679154 Jan 05 15:01:51.315084 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b5c9681-e5ae-4122-a299-847c5b7cceef req-733406cf-5a8e-4cfc-a76d-157c6eb3be1d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673261 Jan 05 15:01:51.349761 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:51.369266 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 45483c3c-9f42-4aff-a962-22ff36647afc {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:01:51.391112 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:51.409253 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a52a55a-d24d-4064-8220-bda25b46ce30 req-d8379a58-a1fa-4258-be8c-a0b39bb1349f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.410601 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-71986f60-3db2-4969-948f-acff8efb7013 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.410726 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3a52a55a-d24d-4064-8220-bda25b46ce30 req-d8379a58-a1fa-4258-be8c-a0b39bb1349f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0576038 Jan 05 15:01:51.412746 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-71986f60-3db2-4969-948f-acff8efb7013 service neutron] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 920 time: 0.1019444 Jan 05 15:01:51.455871 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-3952c583-7e98-4c96-b2d9-aa226d14ffd1 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 217 time: 0.0364916 Jan 05 15:01:51.464092 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:51.486950 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3a52a55a-d24d-4064-8220-bda25b46ce30 req-8c501818-1d38-44e5-a79c-60032c38b844 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601411 Jan 05 15:01:51.529994 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-7a919e60-9500-40b0-891d-40f1005c51d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.531830 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-7a919e60-9500-40b0-891d-40f1005c51d7 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 1098 time: 0.0538239 Jan 05 15:01:51.542802 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=6']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:51.556483 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-896494ad-8ea4-4044-b8d0-feaaa4507f6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.557991 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-896494ad-8ea4-4044-b8d0-feaaa4507f6c service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0790150 Jan 05 15:01:51.593645 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-ed267b88-e910-4c79-8e40-30722f5ec1c6 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0256135 Jan 05 15:01:51.632922 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-c28fcd8a-c8ca-42bc-a419-1e56b4898f14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.634575 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-c28fcd8a-c8ca-42bc-a419-1e56b4898f14 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 911 time: 0.0957344 Jan 05 15:01:51.678645 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['45483c3c-9f42-4aff-a962-22ff36647afc'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:01:51.747302 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 req-0a7eecd4-f9ec-4370-b47f-f3a61621f874 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.748809 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 req-0a7eecd4-f9ec-4370-b47f-f3a61621f874 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 945 time: 0.0951543 Jan 05 15:01:51.754303 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-7f1f966f-5c84-45aa-9a36-41fe988817f7 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1479337 Jan 05 15:01:51.755860 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-22eaff83-7144-407b-bead-3ec6a8f50b2c service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2886de19-8aa3-470c-a593-9381bdb36ca0 HTTP/1.1" status: 200 len: 1000 time: 0.1020033 Jan 05 15:01:51.851621 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c743bae3-b0b3-49d9-9afa-f0259123ffed req-10f2747c-974d-4f28-9067-bd15d9b84815 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.853388 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c743bae3-b0b3-49d9-9afa-f0259123ffed req-10f2747c-974d-4f28-9067-bd15d9b84815 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.1011913 Jan 05 15:01:51.856214 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1553c043-7ee3-47d4-a859-8d64c2f34bc9 req-b7ac720a-28a8-4e7e-a150-9b8574db11b5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0995827 Jan 05 15:01:51.860151 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-e45d73d9-ddae-4e10-9ff5-dbfbfedf5ea7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.861585 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-e45d73d9-ddae-4e10-9ff5-dbfbfedf5ea7 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 200 len: 849 time: 0.0734799 Jan 05 15:01:51.918580 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ec296e1c-b387-41f1-b680-95e7b387c01e req-75d8b3da-a3a7-4482-96f8-3e5cf4e9a8da service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1455204 Jan 05 15:01:51.965701 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c743bae3-b0b3-49d9-9afa-f0259123ffed req-d2704be8-fe5b-4a37-9771-d97e39459059 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030283 Jan 05 15:01:51.976786 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-b40bb939-4954-4f5c-a435-10ce1895621b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:51.978314 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-b40bb939-4954-4f5c-a435-10ce1895621b service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fb7bcda7-5039-4d82-bf68-12c9acc8a744&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0866749 Jan 05 15:01:52.079189 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-b4a2ca85-653a-4977-b802-044e99990b45 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927746 Jan 05 15:01:52.175361 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9306e99c-b3e0-4aab-b346-016210d3e02a req-0439a161-f463-46b2-9915-88a28f07fda0 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871301 Jan 05 15:01:52.440943 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26a7050-6246-423e-ab65-1ecdcb6939a3 req-fb935369-1789-40f3-bbf5-48189c994dbb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:52.442301 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b26a7050-6246-423e-ab65-1ecdcb6939a3 req-fb935369-1789-40f3-bbf5-48189c994dbb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0509205 Jan 05 15:01:52.486587 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b26a7050-6246-423e-ab65-1ecdcb6939a3 req-9e7afce5-fbc5-4a84-8fb3-17a6cf19ebf4 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389004 Jan 05 15:01:52.588958 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53dbf1ae-5544-448a-be32-558db00e915a req-513de6ff-1cd1-4124-8397-aacda27aff47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:52.590558 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-53dbf1ae-5544-448a-be32-558db00e915a req-513de6ff-1cd1-4124-8397-aacda27aff47 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0489666 Jan 05 15:01:52.635954 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-53dbf1ae-5544-448a-be32-558db00e915a req-d0ace87e-a6a6-466f-8b73-d92d1bcce567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399847 Jan 05 15:01:52.979397 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e01f94a-a855-43ce-989a-125ac3268a78 req-6487434c-ee50-4986-aa18-8137d627fc9b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:52.981219 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1e01f94a-a855-43ce-989a-125ac3268a78 req-6487434c-ee50-4986-aa18-8137d627fc9b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 945 time: 0.0488012 Jan 05 15:01:53.032126 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1e01f94a-a855-43ce-989a-125ac3268a78 req-698850c8-29d1-42ab-8b1c-3b0c16f8ce5f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446241 Jan 05 15:01:53.076104 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a254a39-7de0-4763-9291-77d0ce40fd59 req-9f2f9f96-592e-4efb-9a0f-1bd7f05e2dd1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:53.077720 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6a254a39-7de0-4763-9291-77d0ce40fd59 req-9f2f9f96-592e-4efb-9a0f-1bd7f05e2dd1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0489452 Jan 05 15:01:53.125088 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6a254a39-7de0-4763-9291-77d0ce40fd59 req-30b40a8e-8bee-47e8-97f1-9791cb69ce6d tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419033 Jan 05 15:01:53.182867 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:01:53.230358 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 45483c3c-9f42-4aff-a962-22ff36647afc triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:01:53.230729 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:53.308472 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:53.332800 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:01:53.335060 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a892f34-b00d-48c1-98ea-dd796322025a" -d '{"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:01:53.350112 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:53.373796 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:01:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73b4b8ba-d781-486e-b784-bb860a416474 x-openstack-request-id: req-73b4b8ba-d781-486e-b784-bb860a416474 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:01:53.373938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:01:53.376587 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-73b4b8ba-d781-486e-b784-bb860a416474 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:01:53.376587 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc', 'code': 200} Jan 05 15:01:53.435557 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:53.484176 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=7']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:53.612732 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dcc4279-ae2e-457b-9450-f1110a881e27 req-49714e10-798a-4c73-8299-009bc5cddede tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:53.614238 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5dcc4279-ae2e-457b-9450-f1110a881e27 req-49714e10-798a-4c73-8299-009bc5cddede tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0603745 Jan 05 15:01:53.662712 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5dcc4279-ae2e-457b-9450-f1110a881e27 req-e74dcfc0-c7f0-4e21-b5c3-af8107cc8ed5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428925 Jan 05 15:01:53.760615 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587217f1-2040-4a7d-b286-8f0e079ff1f9 req-35c7952e-10a7-4238-a14f-e162d5026264 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:53.762156 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-587217f1-2040-4a7d-b286-8f0e079ff1f9 req-35c7952e-10a7-4238-a14f-e162d5026264 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0574574 Jan 05 15:01:53.813323 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-587217f1-2040-4a7d-b286-8f0e079ff1f9 req-8feb0b84-ef2d-4355-9622-a1ec1fea163b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443976 Jan 05 15:01:54.150663 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02cb8f1-7769-4622-954c-05f9027e5609 req-09c108ee-33ed-470e-a665-5990e1a17d40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:54.152163 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b02cb8f1-7769-4622-954c-05f9027e5609 req-09c108ee-33ed-470e-a665-5990e1a17d40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0474973 Jan 05 15:01:54.203014 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b02cb8f1-7769-4622-954c-05f9027e5609 req-9e546ff1-340c-4cac-a2ca-93abc13723fa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450802 Jan 05 15:01:54.239099 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc50d6ec-ceb8-45fc-b89f-b8645436970a req-e5734653-077e-496b-b74e-b4647171c4b1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:54.240553 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cc50d6ec-ceb8-45fc-b89f-b8645436970a req-e5734653-077e-496b-b74e-b4647171c4b1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0479765 Jan 05 15:01:54.284859 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cc50d6ec-ceb8-45fc-b89f-b8645436970a req-be2e16eb-1efd-44e1-ac85-38a511896b87 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388861 Jan 05 15:01:54.780361 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d584fc5-fc6e-495b-bd43-05e1f4821944 req-f3735f3d-2b94-40bd-b5d3-b3071ff5083c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:54.781867 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4d584fc5-fc6e-495b-bd43-05e1f4821944 req-f3735f3d-2b94-40bd-b5d3-b3071ff5083c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0530782 Jan 05 15:01:54.826416 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4d584fc5-fc6e-495b-bd43-05e1f4821944 req-a9b29cd8-b675-441e-9eab-9db7e98bb907 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391271 Jan 05 15:01:54.928666 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d341d57-a252-4f3f-aeb3-69835517dfe2 req-42917e78-1e65-40c3-a011-76f409ad99fb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:54.930271 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6d341d57-a252-4f3f-aeb3-69835517dfe2 req-42917e78-1e65-40c3-a011-76f409ad99fb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0504093 Jan 05 15:01:54.965366 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:01:54.978079 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6d341d57-a252-4f3f-aeb3-69835517dfe2 req-7a9e5a08-692f-411e-be09-2e179ea21a3c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424268 Jan 05 15:01:55.319491 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f36d13d-7307-40db-ab57-d68b8a1490ab req-d349db4b-ec6d-4b5f-84d8-da6d993ec718 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:55.320980 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3f36d13d-7307-40db-ab57-d68b8a1490ab req-d349db4b-ec6d-4b5f-84d8-da6d993ec718 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0491550 Jan 05 15:01:55.367245 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3f36d13d-7307-40db-ab57-d68b8a1490ab req-4604216f-3a6f-4c0a-a458-d2caa0117b14 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408046 Jan 05 15:01:55.398739 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a9f8da-5436-4bd4-baad-443da5703454 req-18921644-7d62-4dfe-bc0f-4db3f948c789 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:55.400201 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-10a9f8da-5436-4bd4-baad-443da5703454 req-18921644-7d62-4dfe-bc0f-4db3f948c789 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0490081 Jan 05 15:01:55.448928 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-10a9f8da-5436-4bd4-baad-443da5703454 req-c426f91b-4536-44b3-ba46-23256ab343dc tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432842 Jan 05 15:01:55.940346 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b79522-4229-4f03-bd5b-08dd415a1795 req-673d8de1-c65b-4943-a562-497c69267a99 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:55.941851 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-34b79522-4229-4f03-bd5b-08dd415a1795 req-673d8de1-c65b-4943-a562-497c69267a99 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0495462 Jan 05 15:01:55.991066 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-34b79522-4229-4f03-bd5b-08dd415a1795 req-8fc69ccd-9b79-49e4-904d-f64d0ce51c2b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436397 Jan 05 15:01:56.482182 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c94a76-d634-4d4c-a2ba-fb02264088ea req-47e3758f-a958-4f27-a4fd-9b7e9a261fdb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:56.484168 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c3c94a76-d634-4d4c-a2ba-fb02264088ea req-47e3758f-a958-4f27-a4fd-9b7e9a261fdb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0476830 Jan 05 15:01:56.532471 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c3c94a76-d634-4d4c-a2ba-fb02264088ea req-67db5002-2afa-4cd9-a039-1a4e2e1f7034 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414629 Jan 05 15:01:56.569887 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9a99f70-c16c-43c1-8d91-f29c60094080 req-fd35ab62-5e5f-4684-9d83-b64728008db3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:56.571336 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e9a99f70-c16c-43c1-8d91-f29c60094080 req-fd35ab62-5e5f-4684-9d83-b64728008db3 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 944 time: 0.0492959 Jan 05 15:01:56.618016 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e9a99f70-c16c-43c1-8d91-f29c60094080 req-827b48bb-a53d-479a-8926-9c4a7b05b221 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411317 Jan 05 15:01:56.954543 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:01:57.054182 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:57.065835 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0', 'network_id': 'aec55d3c-7bde-4a3f-bf24-eddde8e56c38', 'port_id': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0', 'mac_address': 'fa:16:3e:40:fc:e0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '381a404c-2b76-4214-b59d-06022483de49', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:01:57.103474 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:57.110508 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe req-0a79bf17-85b8-4a92-911c-6ce535a886fc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:57.111991 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe req-0a79bf17-85b8-4a92-911c-6ce535a886fc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0528519 Jan 05 15:01:57.117118 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:01:57.136192 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:01:57.158360 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-78ee8c89-cb19-4be5-b2c5-09a5ee9eb6fe req-67ec7e47-03c2-4f88-9247-6200a936252c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407197 Jan 05 15:01:57.233556 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:57.283761 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:01:57.651096 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00f0491e-f832-442b-8d8c-fff69fa1fc01 req-4a582ce1-0cc6-414b-9a22-f4947590d97a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:57.652560 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-00f0491e-f832-442b-8d8c-fff69fa1fc01 req-4a582ce1-0cc6-414b-9a22-f4947590d97a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0471628 Jan 05 15:01:57.699308 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-00f0491e-f832-442b-8d8c-fff69fa1fc01 req-7ca02b40-8371-4b6d-bef6-286f4a1818de tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399890 Jan 05 15:01:57.732784 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae2c704-7d98-484d-8720-52f99ab8ca3e req-dbce81f2-c41e-4198-97d7-fca6c5d48f0f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:57.735046 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2ae2c704-7d98-484d-8720-52f99ab8ca3e req-dbce81f2-c41e-4198-97d7-fca6c5d48f0f tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 945 time: 0.0503249 Jan 05 15:01:57.779970 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2ae2c704-7d98-484d-8720-52f99ab8ca3e req-20fb7631-3d6e-4b68-9f63-47007269d160 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394933 Jan 05 15:01:58.230024 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4cced98e-3fde-4c45-a875-58eccfb72c5b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:01:58.274571 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20cb26b7-6e34-46b9-a106-8456ffa49202 req-44c289d6-3030-4d47-ae63-a1cc68ecb4bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:58.276051 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-20cb26b7-6e34-46b9-a106-8456ffa49202 req-44c289d6-3030-4d47-ae63-a1cc68ecb4bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0524867 Jan 05 15:01:58.326414 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-20cb26b7-6e34-46b9-a106-8456ffa49202 req-6c23b89d-2364-40dd-8761-93c36d39b5fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447092 Jan 05 15:01:58.463127 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['32e7c026-6194-414c-8f67-f9b7c7e9a4d0'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:01:58.843013 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 req-e8d82708-a6fc-4481-b12e-e41081fd4cfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:58.844882 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 req-e8d82708-a6fc-4481-b12e-e41081fd4cfa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0560317 Jan 05 15:01:58.930702 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8fdc1bdc-f2cb-4849-9657-9a59721aa074 req-4b3e9df0-6118-4cbd-93a8-45877723e85a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0735538 Jan 05 15:01:58.952718 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6b0561-ca65-49f4-81bb-065626b281ee req-a8bf9801-7f5c-43b3-876d-4d2c41360ac1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:58.954837 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2a6b0561-ca65-49f4-81bb-065626b281ee req-a8bf9801-7f5c-43b3-876d-4d2c41360ac1 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 945 time: 0.0755553 Jan 05 15:01:59.025568 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2a6b0561-ca65-49f4-81bb-065626b281ee req-eab82765-339e-409b-a92f-1ba5afdce563 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644081 Jan 05 15:01:59.451994 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5af71b-df71-4727-ba3d-aaf14209d5fb req-0f183b76-1342-42dc-ac00-e8948812743d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:01:59.453720 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4e5af71b-df71-4727-ba3d-aaf14209d5fb req-0f183b76-1342-42dc-ac00-e8948812743d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0508797 Jan 05 15:01:59.517333 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4e5af71b-df71-4727-ba3d-aaf14209d5fb req-4b111d27-9106-4356-9d3d-af23f1473d49 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558975 Jan 05 15:02:00.033778 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:00.082030 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f req-381f2c3f-18c7-4b76-91ac-2ba4e321d1f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:00.088833 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f req-381f2c3f-18c7-4b76-91ac-2ba4e321d1f1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0848064 Jan 05 15:02:00.160261 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 req-9bf9bd35-e570-41a7-9999-4666507372dd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:00.170047 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 req-9bf9bd35-e570-41a7-9999-4666507372dd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 945 time: 0.0710964 Jan 05 15:02:00.218940 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b3b6a60b-cd4e-448b-8a1c-5d63cf81192f req-59de1737-e157-40f0-bfd1-a08c3a3e22ab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1290021 Jan 05 15:02:00.226976 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cbaddc6d-b52f-4803-ad5a-7e198ddbab89 req-c46485d8-a017-4cd1-b9ff-0e49e6a1a2e5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560644 Jan 05 15:02:00.288772 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:02:00.293845 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:00.295966 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:00.416614 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:00.463013 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:02:00.465681 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4163500-0c60-4f77-b6a9-603ce29eca9b" -d '{"events": [{"server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "name": "network-vif-plugged", "status": "completed", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:02:00.481479 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-96546fe2-6b92-48f8-9026-00ce9c501ed1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:00.486776 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:00.513361 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:02:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef21d3bf-f827-4373-926d-b59e67afb32a x-openstack-request-id: req-ef21d3bf-f827-4373-926d-b59e67afb32a {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:02:00.513670 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "name": "network-vif-plugged", "status": "completed", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:02:00.514475 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ef21d3bf-f827-4373-926d-b59e67afb32a {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:02:00.514475 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0', 'code': 200} Jan 05 15:02:00.544601 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:00.612796 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:00.654999 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b0a723-354c-425c-aa56-0e5356895442 req-d928b61b-0de7-4e08-bf23-d8b87e2757c6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:00.662764 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d2b0a723-354c-425c-aa56-0e5356895442 req-d928b61b-0de7-4e08-bf23-d8b87e2757c6 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0748932 Jan 05 15:02:00.716832 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d2b0a723-354c-425c-aa56-0e5356895442 req-75830bf9-a326-4001-bc69-b806c240b2a9 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523491 Jan 05 15:02:01.034008 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e701e8-c683-4633-8316-a06701bb1c41 req-57382608-593a-445e-9be0-868120e4cd19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:01.037507 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-17e701e8-c683-4633-8316-a06701bb1c41 req-57382608-593a-445e-9be0-868120e4cd19 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 1099 time: 0.0972521 Jan 05 15:02:01.097148 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-17e701e8-c683-4633-8316-a06701bb1c41 req-8a9f3477-0453-4cf4-aa10-68d28d5460c3 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406024 Jan 05 15:02:01.421007 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29d40936-4bc0-4031-90d7-1b1e41947a2e req-b7253ff2-a2ff-4e83-95fe-8b289e6b993a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:01.428613 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-29d40936-4bc0-4031-90d7-1b1e41947a2e req-b7253ff2-a2ff-4e83-95fe-8b289e6b993a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0719333 Jan 05 15:02:01.443624 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c137e5-5a9d-4a07-895b-7f515bf7102b req-11515ac7-3a1b-424c-ba7d-4561bd75e982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:01.447969 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e4c137e5-5a9d-4a07-895b-7f515bf7102b req-11515ac7-3a1b-424c-ba7d-4561bd75e982 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0960219 Jan 05 15:02:01.488424 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-29d40936-4bc0-4031-90d7-1b1e41947a2e req-bbd53605-de59-4726-bc75-f2e449de2385 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588381 Jan 05 15:02:01.539552 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e4c137e5-5a9d-4a07-895b-7f515bf7102b req-13529839-9bad-42d7-ab6f-9d6f064d816f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0799439 Jan 05 15:02:01.859940 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646067bd-0594-495e-81da-f0b5b246c06f req-948fee6e-7d3f-4a22-867c-4a667e614108 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:01.861417 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-646067bd-0594-495e-81da-f0b5b246c06f req-948fee6e-7d3f-4a22-867c-4a667e614108 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0520518 Jan 05 15:02:01.907787 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-646067bd-0594-495e-81da-f0b5b246c06f req-55f9b8a9-8e8e-4ac1-9b77-0f4b7b71836c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409782 Jan 05 15:02:02.109474 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:02.633052 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc28f08-21f1-4fa6-961c-5c10e502d778 req-a0d01940-5657-4baa-a766-16d28eb9bf23 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:02.635784 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4fc28f08-21f1-4fa6-961c-5c10e502d778 req-a0d01940-5657-4baa-a766-16d28eb9bf23 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0797246 Jan 05 15:02:02.698868 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4fc28f08-21f1-4fa6-961c-5c10e502d778 req-16d13ece-0d38-41dd-9302-1b1aee915bc7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556109 Jan 05 15:02:02.755865 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:02.764055 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f17896a9-5556-4641-846e-057a894cb5e9 req-67e8a23e-ef45-44af-80d3-231d2cb0e82a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:02.765705 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f17896a9-5556-4641-846e-057a894cb5e9 req-67e8a23e-ef45-44af-80d3-231d2cb0e82a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0799773 Jan 05 15:02:02.817634 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f17896a9-5556-4641-846e-057a894cb5e9 req-d947d00e-e494-48ef-95b3-ebd0d775820f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454502 Jan 05 15:02:03.031512 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb74611-e6f2-45f9-8862-8582553bab86 req-a3078532-82f1-4244-ad32-585a7b25518f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:03.033675 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ecb74611-e6f2-45f9-8862-8582553bab86 req-a3078532-82f1-4244-ad32-585a7b25518f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0523949 Jan 05 15:02:03.089567 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ecb74611-e6f2-45f9-8862-8582553bab86 req-f7d0a2fa-597c-47ff-a364-d9b8814a966d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482686 Jan 05 15:02:03.481745 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:03.828962 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1926164-def1-4a9d-9e12-c2d9b978ad0e req-aa75efb5-ef35-43a9-a1de-ced8f1f430f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:03.830684 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f1926164-def1-4a9d-9e12-c2d9b978ad0e req-aa75efb5-ef35-43a9-a1de-ced8f1f430f7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0575662 Jan 05 15:02:03.893664 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f1926164-def1-4a9d-9e12-c2d9b978ad0e req-3a88267f-8364-465f-8fa9-78ff7a042861 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555737 Jan 05 15:02:03.971319 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d req-3a5a0a31-8f0a-4c5b-9be1-598b00fffad4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:03.973328 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d req-3a5a0a31-8f0a-4c5b-9be1-598b00fffad4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0700204 Jan 05 15:02:04.041086 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c1e5d9a1-329a-48d9-ac22-b145856c7e7d req-6a42a549-629b-442d-94f3-7e7d038cbc71 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0620964 Jan 05 15:02:04.232745 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 req-15f820f8-c9ad-4648-bac5-d49d26bca5e2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:04.234519 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 req-15f820f8-c9ad-4648-bac5-d49d26bca5e2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0597420 Jan 05 15:02:04.285396 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1dbf379-9885-466d-ac71-cb2fb5ba0fb2 req-17a6b41d-3489-425d-96a3-5f44b6d6b533 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443470 Jan 05 15:02:04.392960 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:05.011086 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63207503-f5e3-4e8d-b9ab-99e4bb379225 req-f1ed706d-1851-4ad4-8ea0-a299ac57fbac tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:05.012620 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-63207503-f5e3-4e8d-b9ab-99e4bb379225 req-f1ed706d-1851-4ad4-8ea0-a299ac57fbac tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0486994 Jan 05 15:02:05.078154 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-63207503-f5e3-4e8d-b9ab-99e4bb379225 req-f723a2b7-bf36-49f7-91df-9ba74a7eac24 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506737 Jan 05 15:02:05.168905 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 req-5d275cc2-5bb2-4d7e-9489-f4a85f3197a5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:05.170437 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 req-5d275cc2-5bb2-4d7e-9489-f4a85f3197a5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0512829 Jan 05 15:02:05.217912 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-380bc4a6-4c12-4d9c-aabe-b53bfac1d9e5 req-37956fb8-e5ac-4809-b829-a5a34d349d76 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413096 Jan 05 15:02:05.403334 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b req-73a1db1d-eff4-4dae-84f6-54c491d69d3a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:05.404776 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b req-73a1db1d-eff4-4dae-84f6-54c491d69d3a tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0475304 Jan 05 15:02:05.453160 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6e2df7d6-a4fb-4659-bcea-bff9a691d23b req-70befe85-7ed8-486f-87ee-80fb731fd462 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416589 Jan 05 15:02:06.223303 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 req-804984e8-5d9f-45e7-a062-fda9428262f5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:06.225058 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 req-804984e8-5d9f-45e7-a062-fda9428262f5 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0675309 Jan 05 15:02:06.283341 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-00a2c1c0-d8e7-4b73-9af5-6b36ee1efdd7 req-06568c57-78dc-446b-ac88-f5d3947581fd tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504549 Jan 05 15:02:06.395743 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578c6291-233d-4e57-bb2a-002f250c188c req-2d1f2d2b-195e-49aa-8f8c-93117d174f18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:06.402863 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-578c6291-233d-4e57-bb2a-002f250c188c req-2d1f2d2b-195e-49aa-8f8c-93117d174f18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0955982 Jan 05 15:02:06.451648 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-578c6291-233d-4e57-bb2a-002f250c188c req-da4656e2-520c-40e4-b4fa-8f281de18356 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475585 Jan 05 15:02:06.615274 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 req-276271bc-5160-45f9-b10f-90d9f8a47a1b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:06.617807 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 req-276271bc-5160-45f9-b10f-90d9f8a47a1b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0766604 Jan 05 15:02:06.688157 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-760eb6f9-3cc2-46d9-8a1f-8d0c0a170296 req-7005d07a-a1e8-456c-804e-278f84f9e653 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595183 Jan 05 15:02:07.123415 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 45848) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:07.238670 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64c467f9-4e54-47d6-8a25-061cba7a68c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:07.322306 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64c467f9-4e54-47d6-8a25-061cba7a68c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:07.387284 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64c467f9-4e54-47d6-8a25-061cba7a68c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:07.431146 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 45854) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:07.431644 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-64c467f9-4e54-47d6-8a25-061cba7a68c6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6a0a02799a494b62b05cbded51442335&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3068066 Jan 05 15:02:07.434364 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c467f9-4e54-47d6-8a25-061cba7a68c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ec8b3f2-6b56-4138-8bf9-96a269a88eb9,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:07.534336 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-eb88dd9a-990f-4e59-b893-ff296806b858 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:07.597388 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-eb88dd9a-990f-4e59-b893-ff296806b858 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:07.685209 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f2161c-d60d-4987-af9f-b5838b4422c4 req-ceaef5b0-9d98-4e40-9a79-c4601a16bf2b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:07.691503 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-37f2161c-d60d-4987-af9f-b5838b4422c4 req-ceaef5b0-9d98-4e40-9a79-c4601a16bf2b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0866525 Jan 05 15:02:07.742081 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-37f2161c-d60d-4987-af9f-b5838b4422c4 req-f32e99ac-431e-404c-9a8d-09605e96da88 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495648 Jan 05 15:02:07.750742 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-eb88dd9a-990f-4e59-b893-ff296806b858 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:07.753935 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-eb88dd9a-990f-4e59-b893-ff296806b858 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:07.755640 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-eb88dd9a-990f-4e59-b893-ff296806b858 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5ec8b3f2-6b56-4138-8bf9-96a269a88eb9 HTTP/1.1" status: 204 len: 168 time: 0.3225551 Jan 05 15:02:07.766491 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb88dd9a-990f-4e59-b893-ff296806b858 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ec8b3f2-6b56-4138-8bf9-96a269a88eb9,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:07.905156 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 req-3e1bdac0-9a1b-4450-a591-f5b4651b47fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:07.922904 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 req-3e1bdac0-9a1b-4450-a591-f5b4651b47fb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0807652 Jan 05 15:02:08.006246 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c0d6c084-4f27-4a6f-a845-46db52ce2a67 req-25a29c80-60cf-4220-bd5e-570c7a11abc3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812855 Jan 05 15:02:08.305464 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456b17ea-b375-4daa-89a5-6000728ad1e2 req-fff61e90-80eb-4ccc-bed6-1438b03c344b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:08.307124 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-456b17ea-b375-4daa-89a5-6000728ad1e2 req-fff61e90-80eb-4ccc-bed6-1438b03c344b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0835595 Jan 05 15:02:08.398401 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-456b17ea-b375-4daa-89a5-6000728ad1e2 req-f7b0eb60-2b4d-48c3-98c4-f80b09f3e53a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801861 Jan 05 15:02:08.883920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17540fd-3597-4398-8422-7e61215357ff req-498f96c6-c2f6-4872-9d37-18a2cf348389 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:08.885473 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d17540fd-3597-4398-8422-7e61215357ff req-498f96c6-c2f6-4872-9d37-18a2cf348389 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0532184 Jan 05 15:02:08.937609 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d17540fd-3597-4398-8422-7e61215357ff req-1ebcfdb5-3d75-49ce-834a-54fa3efb3f18 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458283 Jan 05 15:02:09.129539 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5769613-95d7-4d31-95b4-b910b0074e3c req-c168b8e2-b866-44d6-b770-41d91ef27d18 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:09.131015 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c5769613-95d7-4d31-95b4-b910b0074e3c req-c168b8e2-b866-44d6-b770-41d91ef27d18 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0505579 Jan 05 15:02:09.179377 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c5769613-95d7-4d31-95b4-b910b0074e3c req-5964c14d-faaa-4a6a-a4bd-62d150331c1f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428698 Jan 05 15:02:09.513818 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b req-89ac0c22-287f-4382-918f-cddfae5a25ff tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:09.515293 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b req-89ac0c22-287f-4382-918f-cddfae5a25ff tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0551674 Jan 05 15:02:09.564930 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dbb14ae-534f-4638-89a1-3e5e8404ef8b req-4b259444-7c3e-4549-9da3-5f8a55ccb276 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433760 Jan 05 15:02:09.905446 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 45924) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:10.039233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-921748022-network', 'tenant_id': 'b874b608d2c848a88541148e56d2114d'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:10.071678 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34394f7-6790-406f-8b5d-09525e39725d req-5908bf3f-4e64-4913-a034-4812b65304a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:10.073305 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e34394f7-6790-406f-8b5d-09525e39725d req-5908bf3f-4e64-4913-a034-4812b65304a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0537603 Jan 05 15:02:10.124264 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e34394f7-6790-406f-8b5d-09525e39725d req-ed452944-6646-4ecd-860b-a6c70b9d8727 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448117 Jan 05 15:02:10.153120 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Made reservation on behalf of b874b608d2c848a88541148e56d2114d for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:02:10.153120 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.158531 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.237372 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.304409 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b923d63e-a4a1-41bc-ac98-afa929c499ae req-267bdf77-9655-4fe8-b131-b717637f083c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:10.306034 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b923d63e-a4a1-41bc-ac98-afa929c499ae req-267bdf77-9655-4fe8-b131-b717637f083c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0500083 Jan 05 15:02:10.327129 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.365866 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 137} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:02:10.378275 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93cf9114-46da-4d77-8e9e-dda0c5b575f3,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:10.389635 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b923d63e-a4a1-41bc-ac98-afa929c499ae req-2f5ea7b0-84ed-4f17-ad9b-81c39f27a0df tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779114 Jan 05 15:02:10.391210 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.391556 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Added segment 4f800182-f71d-4001-8825-29298b38881e of type vlan for network 88c2382a-d403-4004-b3bd-23c5e1ff004f Jan 05 15:02:10.435178 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.547257 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.548248 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:10.548836 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:10.608724 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] Pushing event updated for resources: {'Network': ['ID=88c2382a-d403-4004-b3bd-23c5e1ff004f,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:10.621424 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:02:10.666828 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c578235e-9b0a-4c56-b4b7-0a6d46aa612a admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7603047 Jan 05 15:02:10.669764 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 45942) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:10.675022 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Request body: {'subnet': {'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-921748022-subnet', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:10.693987 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 req-6a6d7e30-a8b9-45c4-b65e-bec9a31de8c2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:10.695568 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 req-6a6d7e30-a8b9-45c4-b65e-bec9a31de8c2 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0624509 Jan 05 15:02:10.744419 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-62d3cb41-5fc7-4247-a3f4-c519aa9dec82 req-38124878-c4ad-459e-8a14-83c9f8efab62 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433114 Jan 05 15:02:10.778066 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Made reservation on behalf of b874b608d2c848a88541148e56d2114d for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:02:10.781352 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8833947'] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.024472 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8855778', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8833897'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.081100 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Pushing event updated for resources: {'Subnet': ['ID=8f70bd05-fae0-4a73-a39b-d1442f8ef93c,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:11.086315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Checking segment: {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:11.087197 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Network hostable DHCP agents. Network: 88c2382a-d403-4004-b3bd-23c5e1ff004f, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:02:11.187190 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:02:11.244617 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354e65bc-df80-4a35-a3df-c5c550be4abf req-678d2794-3917-4e2f-869a-e48d8dbaa630 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:11.246077 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-354e65bc-df80-4a35-a3df-c5c550be4abf req-678d2794-3917-4e2f-869a-e48d8dbaa630 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0481727 Jan 05 15:02:11.280490 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 88c2382a-d403-4004-b3bd-23c5e1ff004f) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:11.290578 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd216f4b-a42b-4882-b7b1-04d7d2063011 None None] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:02:11.290755 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:11.291328 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.303038 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-354e65bc-df80-4a35-a3df-c5c550be4abf req-3043bba1-dade-406d-b80a-6b26495363e8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514088 Jan 05 15:02:11.396455 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-88c2382a-d403-4004-b3bd-23c5e1ff004f', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'project_id': 'b874b608d2c848a88541148e56d2114d', 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 15:02:11.397331 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.426585 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f9b5c970-a3c9-41b6-98f6-cb33ecaaebcf admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7533827 Jan 05 15:02:11.426770 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 45952) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:11.431472 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:11.506908 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19f731a6-d34e-4e5a-bd22-34579c158c12 req-ce1cd26c-034f-4512-a129-0ce1e5a8085d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:11.508559 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-19f731a6-d34e-4e5a-bd22-34579c158c12 req-ce1cd26c-034f-4512-a129-0ce1e5a8085d tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0485284 Jan 05 15:02:11.534894 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.536053 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.537845 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Allocated IP 172.20.0.2 (88c2382a-d403-4004-b3bd-23c5e1ff004f/8f70bd05-fae0-4a73-a39b-d1442f8ef93c/4093508d-2456-48b1-bd62-3140d1b5dfa7) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:11.562318 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-19f731a6-d34e-4e5a-bd22-34579c158c12 req-f01751cd-d927-476e-a20a-a2128603aef5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474796 Jan 05 15:02:11.598376 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.680224 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.790165 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.796337 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.844278 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:11.854106 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:11.854106 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:11.868678 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47257e1-820d-4a7f-bc77-81edb96035b6 req-08ee6d91-ae86-4fb6-8c20-a14055e50e4a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:11.869361 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Pushing event updated for resources: {'Port': ['ID=4093508d-2456-48b1-bd62-3140d1b5dfa7,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:11.870279 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d47257e1-820d-4a7f-bc77-81edb96035b6 req-08ee6d91-ae86-4fb6-8c20-a14055e50e4a tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0531764 Jan 05 15:02:11.917468 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Attempting to bind port 4093508d-2456-48b1-bd62-3140d1b5dfa7 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:02:11.917836 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Attempting to bind port 4093508d-2456-48b1-bd62-3140d1b5dfa7 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:02:11.918193 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Attempting to bind port 4093508d-2456-48b1-bd62-3140d1b5dfa7 on network 88c2382a-d403-4004-b3bd-23c5e1ff004f {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:02:11.920550 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d47257e1-820d-4a7f-bc77-81edb96035b6 req-c39f51a6-e5be-462a-bbda-170f2e9601c7 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430691 Jan 05 15:02:11.923826 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:02:11.924263 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Checking segment: {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:11.924791 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.925268 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Bound using segment: {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:02:11.925891 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Bound port: 4093508d-2456-48b1-bd62-3140d1b5dfa7, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:02:11.926273 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:11.989193 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] For port 4093508d-2456-48b1-bd62-3140d1b5dfa7, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:02:11.992226 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] For port 4093508d-2456-48b1-bd62-3140d1b5dfa7, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4093508d-2456-48b1-bd62-3140d1b5dfa7,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:02:12.125869 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:12.144785 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:12.159386 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:12.217611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f2585c-0708-4ac2-bc0e-6d5709f610a3 None None] Pushing event updated for resources: {'Port': ['ID=4093508d-2456-48b1-bd62-3140d1b5dfa7,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:12.256244 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Allocated IP 172.37.2.24 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/85c20f33-d1cf-4828-9db0-93081197debc) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:12.450548 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 req-434065c3-e553-40a1-9494-ebd3ebb7de50 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:12.452233 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 req-434065c3-e553-40a1-9494-ebd3ebb7de50 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0711794 Jan 05 15:02:12.521878 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4e2a7933-a835-4221-85ae-3ef44ac18ac1 req-7caf29dc-9236-416c-a69b-d23d59c39bd9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633311 Jan 05 15:02:12.611843 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:12.646974 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-761ac1f2-5a36-4b8e-b7ea-b5806ee1fe76 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:12.649972 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-761ac1f2-5a36-4b8e-b7ea-b5806ee1fe76 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.0941989 Jan 05 15:02:12.706833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf69ea1-dcf1-4a8b-8072-885e77096410 req-02dd82e3-90b3-4b70-b77a-93e4b840ff7b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:12.708334 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7cf69ea1-dcf1-4a8b-8072-885e77096410 req-02dd82e3-90b3-4b70-b77a-93e4b840ff7b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0490675 Jan 05 15:02:12.764721 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7cf69ea1-dcf1-4a8b-8072-885e77096410 req-eca8c574-a4a5-4575-a264-6bb005da10cd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498147 Jan 05 15:02:12.784318 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:12.818982 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Deleting port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:02:12.819592 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:12.824892 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:12.829963 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:12.831330 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:12.838624 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Pushing event updated for resources: {'Port': ['ID=85c20f33-d1cf-4828-9db0-93081197debc,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:12.923586 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] For port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,segment=NetworkSegment(52b64191-c846-4aa1-bf19-9e627b802773),segment_id=52b64191-c846-4aa1-bf19-9e627b802773)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:12.927639 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:12.942071 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Calling delete_port for 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 owned by compute:nova {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:02:13.042942 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-1cb49be3-07a9-485a-b428-ec57b80eb73a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.046152 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-1cb49be3-07a9-485a-b428-ec57b80eb73a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1099 time: 0.0850103 Jan 05 15:02:13.157713 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-a3b5cb2b-88b1-435e-b319-b10c83725036 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.159386 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-a3b5cb2b-88b1-435e-b319-b10c83725036 service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.1075146 Jan 05 15:02:13.276692 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-b57adb0e-8de2-4ca0-aa37-889fba2fa040 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=45483c3c-9f42-4aff-a962-22ff36647afc HTTP/1.1" status: 200 len: 1002 time: 0.1088028 Jan 05 15:02:13.296915 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 req-1aa11407-8bb4-4d1e-8cb0-6cd85ace91ef tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.299019 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 req-1aa11407-8bb4-4d1e-8cb0-6cd85ace91ef tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 946 time: 0.2801178 Jan 05 15:02:13.376922 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:13.382079 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ec68fb4-5bf3-4659-b4b8-f15b1a435ff7 None None] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:02:13.405010 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-939ab1b2-1981-4b00-8e5f-978ff2ea2a31 req-62fc21c3-da36-4755-9ed5-520c6fbbaa3b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/security-groups?id=74d864e5-10ed-40c0-b4fe-005a3392fae4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0901303 Jan 05 15:02:13.416720 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-2a6d99df-4a56-4024-9f03-b3d6ed6cfe94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.418477 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-2a6d99df-4a56-4024-9f03-b3d6ed6cfe94 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.1343417 Jan 05 15:02:13.480580 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-ffaa3f37-2567-458b-b26e-3858d55a5c52 None None] Provisioning complete for port 4093508d-2456-48b1-bd62-3140d1b5dfa7 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:13.480950 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ffaa3f37-2567-458b-b26e-3858d55a5c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:13.517205 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-b2dc7b17-a496-4bc2-990e-e9dcd0205613 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.518689 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-b2dc7b17-a496-4bc2-990e-e9dcd0205613 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0783269 Jan 05 15:02:13.532946 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:13.570734 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Pushing event deleted for resources: {'Port': ['ID=32e7c026-6194-414c-8f67-f9b7c7e9a4d0,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:13.654333 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] No DVR routers for this DVR port 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 on host hv-cinder-maste {{(pid=114655) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:02:13.669738 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:13.674494 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.13 "DELETE /v2.0/ports/32e7c026-6194-414c-8f67-f9b7c7e9a4d0 HTTP/1.1" status: 204 len: 173 time: 1.0166502 Jan 05 15:02:13.674906 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'name': 'network-vif-deleted', 'tag': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:02:13.677455 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8258bf7-1072-4416-a861-b764beeda858" -d '{"events": [{"server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "name": "network-vif-deleted", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:02:13.693930 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['32e7c026-6194-414c-8f67-f9b7c7e9a4d0'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:02:13.718262 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:02:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba x-openstack-request-id: req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:02:13.719611 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69165fdc-1854-4f3f-a46a-6727d1bf96bc", "name": "network-vif-deleted", "tag": "32e7c026-6194-414c-8f67-f9b7c7e9a4d0", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:02:13.719952 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9339c64e-551a-4b4b-81e4-a82bfbb7c4ba {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:02:13.720583 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69165fdc-1854-4f3f-a46a-6727d1bf96bc', 'name': 'network-vif-deleted', 'tag': '32e7c026-6194-414c-8f67-f9b7c7e9a4d0', 'status': 'completed', 'code': 200} Jan 05 15:02:13.752967 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b32150-e5f0-4506-85bc-7df182cfa4f0 req-cd754e38-45a1-4d21-a351-36dc1243b484 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.755210 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75b32150-e5f0-4506-85bc-7df182cfa4f0 req-cd754e38-45a1-4d21-a351-36dc1243b484 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.1688988 Jan 05 15:02:13.789773 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ffaa3f37-2567-458b-b26e-3858d55a5c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:13.793058 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:13.803122 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa req-69de7ee3-7276-4650-acf6-d29fd971fc6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.804667 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa req-69de7ee3-7276-4650-acf6-d29fd971fc6d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.1615286 Jan 05 15:02:13.817045 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-83e6d5ab-357a-4758-9f60-69e9d86ddc14 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2592454 Jan 05 15:02:13.869936 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-ffaa3f37-2567-458b-b26e-3858d55a5c52 None None] For port 4093508d-2456-48b1-bd62-3140d1b5dfa7, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4093508d-2456-48b1-bd62-3140d1b5dfa7,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:13.968830 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ffaa3f37-2567-458b-b26e-3858d55a5c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:13.969007 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 req-663dee05-df8b-40a7-a925-5b322d9c62ce tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:13.970454 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 req-663dee05-df8b-40a7-a925-5b322d9c62ce tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0928650 Jan 05 15:02:13.990190 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75b32150-e5f0-4506-85bc-7df182cfa4f0 req-e47586e2-a641-45ec-af1b-f78c41024616 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2121570 Jan 05 15:02:14.018497 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f1b235e-d23e-4b5b-a48c-0a376e903ffa req-61404ce4-6813-47cb-aea6-fd6f9f2a3f56 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2040858 Jan 05 15:02:14.048800 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffaa3f37-2567-458b-b26e-3858d55a5c52 None None] Pushing event updated for resources: {'Port': ['ID=4093508d-2456-48b1-bd62-3140d1b5dfa7,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:14.088158 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4093508d-2456-48b1-bd62-3140d1b5dfa7 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:14.091148 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0d439ef-623c-4cea-9531-4027bce13c84 req-41d0cb20-bc10-46ba-a2ba-eb6e9735c71e service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2643709 Jan 05 15:02:14.095109 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3f93eaf5-f69b-4abf-87a0-a3049c1722f2 req-7c6ed6cb-3839-45de-8b72-155875fa82af tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1158803 Jan 05 15:02:14.127743 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-bc323a1b-f8e5-48da-b9e1-4e2ed223c8be None None] Provisioning complete for port 4093508d-2456-48b1-bd62-3140d1b5dfa7 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:14.128386 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bc323a1b-f8e5-48da-b9e1-4e2ed223c8be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:14.220124 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4093508d-2456-48b1-bd62-3140d1b5dfa7 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:14.220407 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:14.292811 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114654) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 15:02:14.403210 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:02:14.413223 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Sync routers for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:02:14.425766 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:14.426420 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:14.532267 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1fc44412-fcae-4182-b796-0784552ae8f7 req-0e04b67e-1b7b-4ffc-b01b-5af8aeee725b tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] 10.222.0.30 "GET /v2.0/ports?device_id=69165fdc-1854-4f3f-a46a-6727d1bf96bc HTTP/1.1" status: 200 len: 210 time: 0.0436938 Jan 05 15:02:14.535634 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:14.536954 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-6743cada-18f0-4e05-93f4-acb13f743705 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 3.1092472 Jan 05 15:02:14.539776 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46020) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:14.540522 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:14.753611 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:13Z', 'revision_number': 3, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:14.779817 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Checking router: 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:02:14.780165 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Updating router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 port 85c20f33-d1cf-4828-9db0-93081197debc binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:02:14.808406 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:14.994402 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.153258 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.195754 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e248c40-533a-4949-bef3-8134235e16f1 req-a7703640-b5eb-4fad-b69a-459d2baf0168 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:15.197608 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0e248c40-533a-4949-bef3-8134235e16f1 req-a7703640-b5eb-4fad-b69a-459d2baf0168 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 946 time: 0.0943737 Jan 05 15:02:15.226258 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f47e6e-ee87-414a-8e74-be70968e5155 req-b2456bd7-f9f6-4f59-82c5-a62891d48ccd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:15.227718 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03f47e6e-ee87-414a-8e74-be70968e5155 req-b2456bd7-f9f6-4f59-82c5-a62891d48ccd tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0485306 Jan 05 15:02:15.239757 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Allocated IP 172.20.0.1 (88c2382a-d403-4004-b3bd-23c5e1ff004f/8f70bd05-fae0-4a73-a39b-d1442f8ef93c/4428e5e5-ac3c-4539-9416-7d271e12d15a) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:15.276183 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03f47e6e-ee87-414a-8e74-be70968e5155 req-eb4ca885-6a31-4533-8765-dbdcb19ca3bb tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418136 Jan 05 15:02:15.276692 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0e248c40-533a-4949-bef3-8134235e16f1 req-27a8dd71-99b3-48e1-b423-10723451c7b6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0719965 Jan 05 15:02:15.370043 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.467046 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.513837 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.516028 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Attempting to bind port 85c20f33-d1cf-4828-9db0-93081197debc on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:02:15.516302 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Attempting to bind port 85c20f33-d1cf-4828-9db0-93081197debc by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:02:15.516657 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Attempting to bind port 85c20f33-d1cf-4828-9db0-93081197debc on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:02:15.525856 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:02:15.526224 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:15.526613 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.527007 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:02:15.527454 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Bound port: 85c20f33-d1cf-4828-9db0-93081197debc, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:02:15.527844 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.529334 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Pushing event updated for resources: {'Port': ['ID=85c20f33-d1cf-4828-9db0-93081197debc,revision_number=2']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:15.551395 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:15.554201 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:15.554352 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.554674 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.555033 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.555368 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.555693 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.556022 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.556343 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.556540 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:15.556644 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.556967 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.557382 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.557723 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.558134 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.558346 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:15.586711 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Pushing event updated for resources: {'Port': ['ID=4428e5e5-ac3c-4539-9416-7d271e12d15a,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:15.593172 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] For port 85c20f33-d1cf-4828-9db0-93081197debc, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:02:15.597128 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] For port 85c20f33-d1cf-4828-9db0-93081197debc, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=85c20f33-d1cf-4828-9db0-93081197debc,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:02:15.607206 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.733218 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.791987 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-ecd62f93-5aed-42ba-8b49-d0e6397873e6 None None] Provisioning complete for port 4428e5e5-ac3c-4539-9416-7d271e12d15a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:15.792847 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:15.793149 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ecd62f93-5aed-42ba-8b49-d0e6397873e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.793502 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:15.837447 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f60c785-afda-426d-8b4c-0bbf3922beeb None None] Pushing event updated for resources: {'Port': ['ID=85c20f33-d1cf-4828-9db0-93081197debc,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:15.844347 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:15.866329 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-ecd62f93-5aed-42ba-8b49-d0e6397873e6 None None] Port 4428e5e5-ac3c-4539-9416-7d271e12d15a cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:02:15.924019 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:15.973546 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4093508d-2456-48b1-bd62-3140d1b5dfa7 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:16.037312 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4093508d-2456-48b1-bd62-3140d1b5dfa7 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:16.037868 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:16.072078 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:16.124532 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:02:16.150801 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:13Z', 'revision_number': 3, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:16.151420 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:02:16.151773 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e7c026-6194-414c-8f67-f9b7c7e9a4d0 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:02:16.152191 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:02:16.193871 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d8df77a-966d-4aca-8510-f0c54b1003b0 None None] The sync data for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi is: [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:13Z', 'revision_number': 3, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:02:16.230163 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:16.248549 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:16.274016 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:02:16.276807 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5880b4ac-5f8c-4a1d-9c15-c3bb0c4a40ec" -d '{"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-unplugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:02:16.290101 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:16.323121 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Pushing event updated for resources: {'Port': ['ID=4428e5e5-ac3c-4539-9416-7d271e12d15a,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:16.335286 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 05 Jan 2022 15:02:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd x-openstack-request-id: req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:02:16.335649 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-unplugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:02:16.335908 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-79dba2c1-c9e3-44c8-a00a-4797f5daf1fd {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:02:16.336312 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc', 'code': 200} Jan 05 15:02:16.345131 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:16.384494 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:16.432510 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 req-72200f9d-a2f1-4755-a59a-ecf2d2cb941f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:16.439851 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=8']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:16.442921 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 req-72200f9d-a2f1-4755-a59a-ecf2d2cb941f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0754569 Jan 05 15:02:16.499056 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7c2fc8de-3ddb-4044-bcf1-01a49fa71739 req-4fe892f1-e597-4719-80e3-59b240d627e2 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548143 Jan 05 15:02:16.543688 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f75b99-84e9-4b92-94a6-c59f80add354 req-e8b44d5b-c0d5-4a3d-bb26-f341cf1bd999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:16.545167 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-82f75b99-84e9-4b92-94a6-c59f80add354 req-e8b44d5b-c0d5-4a3d-bb26-f341cf1bd999 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.1119006 Jan 05 15:02:16.559161 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:16.574178 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:16.779607 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-82f75b99-84e9-4b92-94a6-c59f80add354 req-8e211e56-1513-4c84-b992-aed36286f9a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1854808 Jan 05 15:02:16.810441 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:02:16.909723 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-bf81bb3e-023d-4980-b3ee-f49125ab49db None None] Provisioning complete for port 4428e5e5-ac3c-4539-9416-7d271e12d15a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:16.910729 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bf81bb3e-023d-4980-b3ee-f49125ab49db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:16.963702 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:02:16.977555 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-95dece5e-22e5-4980-9c7a-85ca20549e20 admin admin] 10.222.0.30 "PUT /v2.0/routers/2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4282711 Jan 05 15:02:16.977656 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-bf81bb3e-023d-4980-b3ee-f49125ab49db None None] Port 4428e5e5-ac3c-4539-9416-7d271e12d15a cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:02:17.218220 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 req-a68fac0f-86eb-48d6-a71f-2931e0c81e84 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:17.221043 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 req-a68fac0f-86eb-48d6-a71f-2931e0c81e84 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0528083 Jan 05 15:02:17.277138 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6ccb9c3a-b3be-46e4-8f9b-9952f449f387 req-672df66c-9759-4465-8bbc-24bc3628b50c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503569 Jan 05 15:02:17.378914 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-a59a312b-c12b-48b9-b643-7c40238a498b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:17.380441 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-a59a312b-c12b-48b9-b643-7c40238a498b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=9c7d005c6e9e454fa506907144639917&device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 1098 time: 0.0515041 Jan 05 15:02:17.491606 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-3bf76635-bfa3-4c1f-a528-c6336257f9ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:17.493779 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-3bf76635-bfa3-4c1f-a528-c6336257f9ac service neutron] 10.222.0.13 "GET /v2.0/networks?id=975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 200 len: 920 time: 0.1001496 Jan 05 15:02:17.538203 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-0412f4f4-a5f6-4329-aca4-3c3ac7c9bcd2 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 200 len: 217 time: 0.0376151 Jan 05 15:02:17.589731 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-e46cc27e-2e1c-49ab-9a18-d8c3e3e97717 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:17.591205 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-e46cc27e-2e1c-49ab-9a18-d8c3e3e97717 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 200 len: 859 time: 0.0474997 Jan 05 15:02:17.622660 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-0a1e5243-17fa-4e78-9f31-91c8afd8afe0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=975fa447-11a2-47cd-86bf-82619c2a8abd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253835 Jan 05 15:02:17.669258 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46134) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:17.982781 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73aeb956-9671-4da2-896d-d29a91c9640b req-e2504c93-33d5-451f-993c-875b08bb5d7e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:17.984727 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73aeb956-9671-4da2-896d-d29a91c9640b req-e2504c93-33d5-451f-993c-875b08bb5d7e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0769758 Jan 05 15:02:17.985567 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46146) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:17.987617 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-b695fba1-8757-43c1-9bf8-423591c611bb service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3587139 Jan 05 15:02:17.992400 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-34cbbae9-bdcb-4cea-b752-7120612c39f8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.042541 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73aeb956-9671-4da2-896d-d29a91c9640b req-c1c16c09-97c4-4452-b7f8-580c28086c8c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521507 Jan 05 15:02:18.058477 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46152) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:18.061615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 85c20f33-d1cf-4828-9db0-93081197debc up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:18.064608 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1323676408-network', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:18.106649 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-34cbbae9-bdcb-4cea-b752-7120612c39f8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.139404 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 85c20f33-d1cf-4828-9db0-93081197debc triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:18.139404 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.218378 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Made reservation on behalf of c9dbadb18d1c4e888fda9d242ffdaf05 for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:02:18.221336 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.238436 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.242056 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.245371 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-db16ff9b-758e-4a71-82ea-a3f34e0b4685 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.255507 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-34cbbae9-bdcb-4cea-b752-7120612c39f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.260679 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 85c20f33-d1cf-4828-9db0-93081197debc, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=85c20f33-d1cf-4828-9db0-93081197debc,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:18.280610 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Sync routers for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:02:18.290571 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:18.291350 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:18.298314 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-34cbbae9-bdcb-4cea-b752-7120612c39f8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4a24108332144b53b211ee05656bc9b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6241410 Jan 05 15:02:18.298613 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46158) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:18.299702 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34cbbae9-bdcb-4cea-b752-7120612c39f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8c63cd0-c867-4ef8-8a14-56a7ea7efa96,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:18.372344 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.463577 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:18.477553 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.492360 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7071f29a-91f9-4432-bac7-5cc2c9367353 req-922d561e-78ad-48c7-9b18-bf453c135b00 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:18.493881 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7071f29a-91f9-4432-bac7-5cc2c9367353 req-922d561e-78ad-48c7-9b18-bf453c135b00 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.1326725 Jan 05 15:02:18.494042 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=85c20f33-d1cf-4828-9db0-93081197debc,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:18.501224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-304ae190-2dc1-4ffc-81ab-563f5e006eb4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.504045 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-db16ff9b-758e-4a71-82ea-a3f34e0b4685 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.539089 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-304ae190-2dc1-4ffc-81ab-563f5e006eb4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.566062 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.603288 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-db16ff9b-758e-4a71-82ea-a3f34e0b4685 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.610340 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 138} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:02:18.618770 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7071f29a-91f9-4432-bac7-5cc2c9367353 req-fc966ec6-dc30-4ba4-b37d-dbb7c8880946 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1126347 Jan 05 15:02:18.642320 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.642663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Added segment 5fc64c84-d896-467c-ad80-83d994431561 of type vlan for network 7441d551-57f6-41fa-83f4-a4a20584abd5 Jan 05 15:02:18.658849 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54c9dc46-fcad-408e-a03c-c0c308d04e48,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:18.684407 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 2, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:18.700885 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-db16ff9b-758e-4a71-82ea-a3f34e0b4685 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=07f202371473497a9f8970497a54ae30&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7115924 Jan 05 15:02:18.703941 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46170) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:18.713107 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Checking router: 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:02:18.713484 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Updating router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 port 4428e5e5-ac3c-4539-9416-7d271e12d15a binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:02:18.717667 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db16ff9b-758e-4a71-82ea-a3f34e0b4685 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce9a2f7b-6161-4345-a904-0e743e3f161f,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:18.722604 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.739287 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.756835 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e2102e67-b0f4-486d-8934-4bdac565ffee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.783058 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e2102e67-b0f4-486d-8934-4bdac565ffee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.806869 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-304ae190-2dc1-4ffc-81ab-563f5e006eb4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.809793 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-304ae190-2dc1-4ffc-81ab-563f5e006eb4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.813973 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-304ae190-2dc1-4ffc-81ab-563f5e006eb4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e8c63cd0-c867-4ef8-8a14-56a7ea7efa96 HTTP/1.1" status: 204 len: 168 time: 0.5116217 Jan 05 15:02:18.819339 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304ae190-2dc1-4ffc-81ab-563f5e006eb4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8c63cd0-c867-4ef8-8a14-56a7ea7efa96,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:18.875361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.876368 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:18.877012 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:18.936552 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] Pushing event updated for resources: {'Network': ['ID=7441d551-57f6-41fa-83f4-a4a20584abd5,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:18.951898 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:02:19.024358 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e2102e67-b0f4-486d-8934-4bdac565ffee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.027153 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e2102e67-b0f4-486d-8934-4bdac565ffee admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.031019 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-e2102e67-b0f4-486d-8934-4bdac565ffee admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ce9a2f7b-6161-4345-a904-0e743e3f161f HTTP/1.1" status: 204 len: 168 time: 0.3231716 Jan 05 15:02:19.044708 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2102e67-b0f4-486d-8934-4bdac565ffee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce9a2f7b-6161-4345-a904-0e743e3f161f,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:19.067682 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-004aa80b-0abd-4c1c-8438-5c058d323442 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.0079615 Jan 05 15:02:19.068992 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46176) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:19.076052 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Request body: {'subnet': {'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1323676408-subnet', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:19.076626 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.455815 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.457497 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Made reservation on behalf of c9dbadb18d1c4e888fda9d242ffdaf05 for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:02:19.466433 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8833947'] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.606566 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c872eb9-f4e4-476a-aeaf-78e232064bce None None] Pushing event updated for resources: {'Port': ['ID=4428e5e5-ac3c-4539-9416-7d271e12d15a,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:19.634957 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Attempting to bind port 4428e5e5-ac3c-4539-9416-7d271e12d15a on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:02:19.635333 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Attempting to bind port 4428e5e5-ac3c-4539-9416-7d271e12d15a by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:02:19.635889 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Attempting to bind port 4428e5e5-ac3c-4539-9416-7d271e12d15a on network 88c2382a-d403-4004-b3bd-23c5e1ff004f {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:02:19.642617 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:02:19.643161 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Checking segment: {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:19.643575 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.643797 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Bound using segment: {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:02:19.644281 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Bound port: 4428e5e5-ac3c-4539-9416-7d271e12d15a, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:02:19.644754 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.742037 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] For port 4428e5e5-ac3c-4539-9416-7d271e12d15a, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:02:19.745655 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] For port 4428e5e5-ac3c-4539-9416-7d271e12d15a, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4428e5e5-ac3c-4539-9416-7d271e12d15a,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:02:19.798371 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b3985c-ebad-4ce0-9d32-513dffe17198 req-f4552b10-550a-49e1-b8b5-5cb2afd6d61c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:19.799854 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e5b3985c-ebad-4ce0-9d32-513dffe17198 req-f4552b10-550a-49e1-b8b5-5cb2afd6d61c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0539689 Jan 05 15:02:19.819154 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8855778', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8833897'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.820933 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-be62c88b-44ae-4cfc-b98b-afa1803a779a None None] Provisioning complete for port 4428e5e5-ac3c-4539-9416-7d271e12d15a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:19.821381 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-be62c88b-44ae-4cfc-b98b-afa1803a779a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.853396 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:19.916223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7f49c491-a2a8-42a7-95de-10fbdafda631,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:19.916494 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-be62c88b-44ae-4cfc-b98b-afa1803a779a None None] Port 4428e5e5-ac3c-4539-9416-7d271e12d15a cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:02:19.916722 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e5b3985c-ebad-4ce0-9d32-513dffe17198 req-ee5ea98c-4535-462b-af28-da41068a4d27 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1053393 Jan 05 15:02:19.931334 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Checking segment: {'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:19.931824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Network hostable DHCP agents. Network: 7441d551-57f6-41fa-83f4-a4a20584abd5, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:02:19.952333 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c872eb9-f4e4-476a-aeaf-78e232064bce None None] Pushing event updated for resources: {'Port': ['ID=4428e5e5-ac3c-4539-9416-7d271e12d15a,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:19.952333 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:19.952333 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:20.024605 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 85c20f33-d1cf-4828-9db0-93081197debc up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:20.094469 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [req-8bdf0663-af8d-44be-802f-030be5ca4ad4 req-8f75f06c-b839-46d5-a9c8-03b7efa7ff69 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114655) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 15:02:20.096175 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8bdf0663-af8d-44be-802f-030be5ca4ad4 req-8f75f06c-b839-46d5-a9c8-03b7efa7ff69 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0067220 Jan 05 15:02:20.103905 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:20.136393 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:02:20.291843 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 7441d551-57f6-41fa-83f4-a4a20584abd5) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:20.300813 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:20.301400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.311182 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46194) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:20.318722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-826fc03b-18b7-43d8-a839-14cc4f3a7a70 None None] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:02:20.320967 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:02:20.330483 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d35d42db-8d8e-4f41-9aa9-6c8120da996d admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.344340 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37e788a1-a6f2-4816-b9bd-0f99b154944b req-c452f0e1-2b37-4034-bdd6-772fc43af537 service neutron] 10.222.0.13 "GET /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1073151 Jan 05 15:02:20.361328 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 85c20f33-d1cf-4828-9db0-93081197debc triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:20.361705 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.399231 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f3a84809-1811-4797-861a-440b485948e0 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.3287849 Jan 05 15:02:20.401618 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46198) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:20.407713 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:20.446135 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d35d42db-8d8e-4f41-9aa9-6c8120da996d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.482494 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b964930-f7d4-4b8c-9984-b30c08efeeeb None None] Provisioning complete for port 4428e5e5-ac3c-4539-9416-7d271e12d15a triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:20.482861 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b964930-f7d4-4b8c-9984-b30c08efeeeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.508006 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f9e500-d6d0-4044-84f2-13a69ca6d994 req-c49e09a4-675e-41b2-9637-1c7dbe4781fb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:20.513846 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-42f9e500-d6d0-4044-84f2-13a69ca6d994 req-c49e09a4-675e-41b2-9637-1c7dbe4781fb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0573835 Jan 05 15:02:20.516672 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.518833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.550497 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d35d42db-8d8e-4f41-9aa9-6c8120da996d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.600705 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d35d42db-8d8e-4f41-9aa9-6c8120da996d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b9b76b14ed96434f91a058f39f1e1355&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2853916 Jan 05 15:02:20.600705 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d35d42db-8d8e-4f41-9aa9-6c8120da996d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d1de3a3-c068-4e3d-a49c-9ce92adca11a,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:20.602995 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46208) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:20.617766 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.657203 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-7441d551-57f6-41fa-83f4-a4a20584abd5', 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5', 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'fixed_ips': [{'subnet_id': '7f49c491-a2a8-42a7-95de-10fbdafda631'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 15:02:20.658069 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.663749 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c8f631a-7ca2-4699-93d9-885326555fb5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.668880 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-42f9e500-d6d0-4044-84f2-13a69ca6d994 req-f975e1ce-059f-4bfe-acdc-55d7bf20022f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1454129 Jan 05 15:02:20.704486 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c8f631a-7ca2-4699-93d9-885326555fb5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.773717 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b964930-f7d4-4b8c-9984-b30c08efeeeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.811012 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:19Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:20.845714 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ecd76f3-f9d0-4357-b256-549bc79dc055 None None] The sync data for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi is: [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:19Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:02:20.849834 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b964930-f7d4-4b8c-9984-b30c08efeeeb None None] For port 4428e5e5-ac3c-4539-9416-7d271e12d15a, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4428e5e5-ac3c-4539-9416-7d271e12d15a,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:20.859098 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c8f631a-7ca2-4699-93d9-885326555fb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.862559 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c8f631a-7ca2-4699-93d9-885326555fb5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.865450 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9c8f631a-7ca2-4699-93d9-885326555fb5 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8d1de3a3-c068-4e3d-a49c-9ce92adca11a HTTP/1.1" status: 204 len: 168 time: 0.2608552 Jan 05 15:02:20.889026 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8f631a-7ca2-4699-93d9-885326555fb5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d1de3a3-c068-4e3d-a49c-9ce92adca11a,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:20.905797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:20.971802 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b964930-f7d4-4b8c-9984-b30c08efeeeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.098397 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b req-657cd923-d8cb-49fc-a38c-89af98d05844 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:21.110278 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b req-657cd923-d8cb-49fc-a38c-89af98d05844 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0819860 Jan 05 15:02:21.117110 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b964930-f7d4-4b8c-9984-b30c08efeeeb None None] Pushing event updated for resources: {'Port': ['ID=4428e5e5-ac3c-4539-9416-7d271e12d15a,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:21.135010 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Allocated IP 172.20.0.2 (7441d551-57f6-41fa-83f4-a4a20584abd5/7f49c491-a2a8-42a7-95de-10fbdafda631/3dcd533d-f5d8-4fc9-990f-04dd59906592) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:21.183879 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5982e8ec-7ce1-45f3-a152-0a9d08b3705b req-1b940868-d55d-403b-b279-8923ae1813c1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704737 Jan 05 15:02:21.282819 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.303934 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.363966 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.433914 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46232) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:21.438072 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Allocated IP 172.37.2.210 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/e4a8a036-11d1-4e94-99b6-cd4135f12991) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:21.444996 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.520545 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Pushing event updated for resources: {'Port': ['ID=3dcd533d-f5d8-4fc9-990f-04dd59906592,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:21.563460 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:21.570261 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:21.578694 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:21.635192 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-72fb12d2-4211-4a51-b839-34838a6aecf6 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1996596 Jan 05 15:02:21.649814 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-92288c70-53ac-483b-ac7b-09f34f1c0231 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114655) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 15:02:21.650806 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-92288c70-53ac-483b-ac7b-09f34f1c0231 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054514 Jan 05 15:02:21.659476 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.671245 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Attempting to bind port 3dcd533d-f5d8-4fc9-990f-04dd59906592 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:02:21.672162 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Attempting to bind port 3dcd533d-f5d8-4fc9-990f-04dd59906592 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:02:21.672741 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Attempting to bind port 3dcd533d-f5d8-4fc9-990f-04dd59906592 on network 7441d551-57f6-41fa-83f4-a4a20584abd5 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:02:21.678711 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:02:21.679527 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Checking segment: {'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:21.680002 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.680786 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Bound using segment: {'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:02:21.681685 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Bound port: 3dcd533d-f5d8-4fc9-990f-04dd59906592, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:02:21.682141 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.803850 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] For port 3dcd533d-f5d8-4fc9-990f-04dd59906592, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:02:21.807981 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] For port 3dcd533d-f5d8-4fc9-990f-04dd59906592, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3dcd533d-f5d8-4fc9-990f-04dd59906592,segment=NetworkSegment(5fc64c84-d896-467c-ad80-83d994431561),segment_id=5fc64c84-d896-467c-ad80-83d994431561)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:02:21.830525 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e370222-6b09-4a6c-b26d-d401d0f6c746 req-e3a047d4-0234-4165-8843-39cbd1340693 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:21.832120 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1e370222-6b09-4a6c-b26d-d401d0f6c746 req-e3a047d4-0234-4165-8843-39cbd1340693 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0683537 Jan 05 15:02:21.876293 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.884986 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:21.916073 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1e370222-6b09-4a6c-b26d-d401d0f6c746 req-e4376c01-56d2-4a3c-8c8e-45e0f91a696d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0757606 Jan 05 15:02:21.953845 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e237da-ba0a-4e12-bf37-028f53e2b099 None None] Pushing event updated for resources: {'Port': ['ID=3dcd533d-f5d8-4fc9-990f-04dd59906592,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:21.993722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:22.004231 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:22.004231 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:22.058633 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Pushing event updated for resources: {'Port': ['ID=e4a8a036-11d1-4e94-99b6-cd4135f12991,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:22.105817 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4428e5e5-ac3c-4539-9416-7d271e12d15a up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:22.157816 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4428e5e5-ac3c-4539-9416-7d271e12d15a triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:22.158501 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:22.475775 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e req-2479eb56-f92a-4fae-b1e7-d4a111844a23 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:22.485008 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e req-2479eb56-f92a-4fae-b1e7-d4a111844a23 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.1108849 Jan 05 15:02:22.593355 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:22.623040 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7cfe8de4-5f2b-4355-9d66-668d3c56ab8e req-89863133-b22f-4283-ad18-f988ecc4037f tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1368370 Jan 05 15:02:22.882355 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:23.144741 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Router 91b221f6-566d-474c-8811-df9475b6ebfe is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114654) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 15:02:23.166459 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8933f1a4-de96-4e59-ae82-f01de73609d0 req-79f00655-b235-409f-94c2-26dcd7bd5fd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:23.168961 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8933f1a4-de96-4e59-ae82-f01de73609d0 req-79f00655-b235-409f-94c2-26dcd7bd5fd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0858808 Jan 05 15:02:23.326623 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8933f1a4-de96-4e59-ae82-f01de73609d0 req-7f621bc6-c02b-42ea-acf7-3e0dc0282d72 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1473429 Jan 05 15:02:23.727416 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:02:23.739154 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Sync routers for ids ['91b221f6-566d-474c-8811-df9475b6ebfe'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:02:23.763505 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e65d3cc-c5c2-4bbd-b79f-f59204239b25 None None] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:02:23.779000 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c68543-5478-4033-b808-b23267a08ea3 req-478f90e6-855a-43c8-987e-19c5439980ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:23.788249 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-96c68543-5478-4033-b808-b23267a08ea3 req-478f90e6-855a-43c8-987e-19c5439980ab tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0827062 Jan 05 15:02:23.790993 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Routers {'91b221f6-566d-474c-8811-df9475b6ebfe'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:23.792658 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['91b221f6-566d-474c-8811-df9475b6ebfe'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:23.876120 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-96c68543-5478-4033-b808-b23267a08ea3 req-1fc6aa3f-f8c7-447d-bd0f-f83efce457c7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796769 Jan 05 15:02:23.912395 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:23.915962 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2abcaca1-c550-44c4-b2c6-708f746e5b39 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.5108848 Jan 05 15:02:23.917864 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46308) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:23.975248 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Provisioning complete for port 3dcd533d-f5d8-4fc9-990f-04dd59906592 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:23.977543 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:24.044252 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Set router 91b221f6-566d-474c-8811-df9475b6ebfe gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:24.160883 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 3dcd533d-f5d8-4fc9-990f-04dd59906592 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:24.448596 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:24.455905 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 3dcd533d-f5d8-4fc9-990f-04dd59906592 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:24.456437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:24.491093 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210'}], 'enable_snat': True}, 'gw_port_id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:02:22Z', 'revision_number': 3, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port': {'id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2a:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:21Z', 'updated_at': '2022-01-05T15:02:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:24.575467 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Checking router: 91b221f6-566d-474c-8811-df9475b6ebfe for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:02:24.576872 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Updating router 91b221f6-566d-474c-8811-df9475b6ebfe port e4a8a036-11d1-4e94-99b6-cd4135f12991 binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:02:24.590968 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22becbdc-ae9b-477e-a4db-7026724c3021 req-87eaf101-da58-4fb4-bccb-e41bb7511bfe tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:24.591817 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] For port 3dcd533d-f5d8-4fc9-990f-04dd59906592, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3dcd533d-f5d8-4fc9-990f-04dd59906592,segment=NetworkSegment(5fc64c84-d896-467c-ad80-83d994431561),segment_id=5fc64c84-d896-467c-ad80-83d994431561)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:24.608557 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-22becbdc-ae9b-477e-a4db-7026724c3021 req-87eaf101-da58-4fb4-bccb-e41bb7511bfe tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.1264815 Jan 05 15:02:24.647440 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:24.714031 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:24.720381 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-22becbdc-ae9b-477e-a4db-7026724c3021 req-b55b327f-9be4-4fc4-a0fd-bddca8f7f328 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1076937 Jan 05 15:02:24.755799 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.000389 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.038856 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.159160 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.db.api [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=114656) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jan 05 15:02:25.159844 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG oslo_db.api [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jan 05 15:02:25.166227 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Pushing event updated for resources: {'Port': ['ID=3dcd533d-f5d8-4fc9-990f-04dd59906592,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:25.167439 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.176362 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.176754 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.177324 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.177527 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.177852 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.178179 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.178501 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.178822 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.179139 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.179473 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.179794 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.180108 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.180416 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf55a34f-acb5-44fb-98d0-5be686037246 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.185355 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-d9c2d136-8589-454f-8276-cfbede42f458 None None] Provisioning complete for port 3dcd533d-f5d8-4fc9-990f-04dd59906592 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:25.185741 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-d9c2d136-8589-454f-8276-cfbede42f458 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.220470 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc909ac3-6c33-498a-942a-595f66a76641 None None] Pushing event updated for resources: {'Port': ['ID=e4a8a036-11d1-4e94-99b6-cd4135f12991,revision_number=2']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:25.225289 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Allocated IP 172.20.0.1 (7441d551-57f6-41fa-83f4-a4a20584abd5/7f49c491-a2a8-42a7-95de-10fbdafda631/6f356e12-c763-4764-a58c-8fbea3babcad) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:25.256996 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Attempting to bind port e4a8a036-11d1-4e94-99b6-cd4135f12991 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:02:25.257478 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Attempting to bind port e4a8a036-11d1-4e94-99b6-cd4135f12991 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:02:25.257845 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Attempting to bind port e4a8a036-11d1-4e94-99b6-cd4135f12991 on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:02:25.263439 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:02:25.263825 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:25.264213 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.264613 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:02:25.265107 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Bound port: e4a8a036-11d1-4e94-99b6-cd4135f12991, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:02:25.266084 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.336733 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.344280 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] For port e4a8a036-11d1-4e94-99b6-cd4135f12991, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:02:25.348517 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] For port e4a8a036-11d1-4e94-99b6-cd4135f12991, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e4a8a036-11d1-4e94-99b6-cd4135f12991,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:02:25.573256 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.573691 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.657046 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Routers {'91b221f6-566d-474c-8811-df9475b6ebfe'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:25.657704 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['91b221f6-566d-474c-8811-df9475b6ebfe'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:25.681732 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:25.685909 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:25.698850 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:25.698956 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc909ac3-6c33-498a-942a-595f66a76641 None None] Pushing event updated for resources: {'Port': ['ID=e4a8a036-11d1-4e94-99b6-cd4135f12991,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:25.700363 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Pushing event updated for resources: {'Port': ['ID=6f356e12-c763-4764-a58c-8fbea3babcad,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:25.775342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.775342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.775342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.775342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.775342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.777948 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.778323 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.778659 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.779039 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.779778 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.779778 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.780743 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.781742 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:25.814618 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:25.844865 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] Set router 91b221f6-566d-474c-8811-df9475b6ebfe gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:26.079247 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 3dcd533d-f5d8-4fc9-990f-04dd59906592 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:26.172514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:26.207471 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 3dcd533d-f5d8-4fc9-990f-04dd59906592 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:26.208092 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:26.294590 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210'}], 'enable_snat': True}, 'gw_port_id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:02:22Z', 'revision_number': 3, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port': {'id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2a:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:21Z', 'updated_at': '2022-01-05T15:02:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:26.315535 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-0dc34bde-c7fa-4db0-95a2-08e1088ca242 None None] Provisioning complete for port 6f356e12-c763-4764-a58c-8fbea3babcad triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:26.315896 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0dc34bde-c7fa-4db0-95a2-08e1088ca242 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:26.327035 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 req-bb579508-37f0-4d90-a0b3-8f44df1821a0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:26.334541 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bf359c-180c-4292-bb1a-951d467a1b90 None None] The sync data for ids ['91b221f6-566d-474c-8811-df9475b6ebfe'] in dv-cinder-master-3-iscsi is: [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210'}], 'enable_snat': True}, 'gw_port_id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:02:22Z', 'revision_number': 3, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port': {'id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2a:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:21Z', 'updated_at': '2022-01-05T15:02:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:02:26.337627 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 req-bb579508-37f0-4d90-a0b3-8f44df1821a0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.4134631 Jan 05 15:02:26.359384 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-c6c0c4f7-102c-4182-a526-8d31dc7a2691 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:26.360875 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-c6c0c4f7-102c-4182-a526-8d31dc7a2691 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75&tenant_id=f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 1097 time: 0.4167373 Jan 05 15:02:26.478961 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-0dc34bde-c7fa-4db0-95a2-08e1088ca242 None None] Port 6f356e12-c763-4764-a58c-8fbea3babcad cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:02:26.685372 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19121cd8-bd98-4224-9ff7-824e22f1f1a3 req-a5a492fd-c968-4625-8c27-8f3879f00693 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3296242 Jan 05 15:02:26.694015 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-323a258a-42de-489d-bd43-5d3a7131b4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:26.695617 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-323a258a-42de-489d-bd43-5d3a7131b4f3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1097 time: 0.2569582 Jan 05 15:02:26.887480 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-65da7110-f52e-4658-88c8-89839838722f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:26.888771 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-65da7110-f52e-4658-88c8-89839838722f service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.1869605 Jan 05 15:02:26.918440 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:26.990001 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-2db00148-39ef-4c8c-ac37-2ef7adc08294 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=45483c3c-9f42-4aff-a962-22ff36647afc HTTP/1.1" status: 200 len: 1000 time: 0.0944335 Jan 05 15:02:27.062996 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-4b1c5a57-07c4-4885-96d1-8da185d5d125 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:27.063498 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-4b1c5a57-07c4-4885-96d1-8da185d5d125 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0656433 Jan 05 15:02:27.065464 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:27.119434 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:27.218387 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Pushing event updated for resources: {'Port': ['ID=6f356e12-c763-4764-a58c-8fbea3babcad,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:27.306583 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-8faa6574-b872-4b02-bf8c-b2af36fb949b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:27.308188 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-8faa6574-b872-4b02-bf8c-b2af36fb949b service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1932623 Jan 05 15:02:27.412892 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:27.415953 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:27.486568 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-5a9a67a9-e2bd-4ba8-b3c2-75a0fff421f7 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1645284 Jan 05 15:02:27.604858 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Router 91b221f6-566d-474c-8811-df9475b6ebfe has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:02:27.773714 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b324be6e-c11e-4232-bed9-a91b7b8be80d req-8be928a6-79fc-4870-bea0-560f6650d008 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2799504 Jan 05 15:02:27.826320 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-df7259a5-0f51-466b-a498-0f4bab98b60d None None] Provisioning complete for port 6f356e12-c763-4764-a58c-8fbea3babcad triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:27.827579 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-df7259a5-0f51-466b-a498-0f4bab98b60d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:27.896357 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-df7259a5-0f51-466b-a498-0f4bab98b60d None None] Port 6f356e12-c763-4764-a58c-8fbea3babcad cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:02:27.918484 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:02:27.932102 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-664d26bc-1578-4f23-9e87-5e5ef9aeb89c admin admin] 10.222.0.30 "PUT /v2.0/routers/91b221f6-566d-474c-8811-df9475b6ebfe/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0131114 Jan 05 15:02:27.990514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5852ca89-4acd-4f26-8701-86ada6d28cb8 req-26967ded-0409-4e47-a473-0e41737c564e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:27.992253 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5852ca89-4acd-4f26-8701-86ada6d28cb8 req-26967ded-0409-4e47-a473-0e41737c564e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.1561375 Jan 05 15:02:28.113582 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device e4a8a036-11d1-4e94-99b6-cd4135f12991 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:28.168629 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5852ca89-4acd-4f26-8701-86ada6d28cb8 req-52ef8727-5f9e-4f65-9a4a-2f9d4c041b29 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1697154 Jan 05 15:02:28.284798 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1c60ca41-2427-4740-898c-45b4c9af1a10 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:28.317353 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port e4a8a036-11d1-4e94-99b6-cd4135f12991 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:28.318067 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:28.425014 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:28.459683 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port e4a8a036-11d1-4e94-99b6-cd4135f12991, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e4a8a036-11d1-4e94-99b6-cd4135f12991,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:28.555887 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:28.636358 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=e4a8a036-11d1-4e94-99b6-cd4135f12991,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:28.891627 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46420) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:28.923327 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Sync routers for ids ['91b221f6-566d-474c-8811-df9475b6ebfe'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:02:28.964137 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Routers {'91b221f6-566d-474c-8811-df9475b6ebfe'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:28.965360 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['91b221f6-566d-474c-8811-df9475b6ebfe'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:29.131931 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fecd818a-1ea5-43d9-8715-87afa2a8b7b2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.244321 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Set router 91b221f6-566d-474c-8811-df9475b6ebfe gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:29.308644 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fecd818a-1ea5-43d9-8715-87afa2a8b7b2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.368894 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6207a401-a819-46c5-b89b-8ff63bd59bb7 req-37846235-79bd-454e-b391-109411fca805 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:29.386960 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6207a401-a819-46c5-b89b-8ff63bd59bb7 req-37846235-79bd-454e-b391-109411fca805 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0760326 Jan 05 15:02:29.393314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fecd818a-1ea5-43d9-8715-87afa2a8b7b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.453195 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fecd818a-1ea5-43d9-8715-87afa2a8b7b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92e34978-a4e4-4007-bdbe-5329d59f6793,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:29.507148 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6207a401-a819-46c5-b89b-8ff63bd59bb7 req-afc1b860-935e-4e81-878b-5772183119d1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1186454 Jan 05 15:02:29.526120 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-fecd818a-1ea5-43d9-8715-87afa2a8b7b2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d895eaa10dfa4f81adf06e0cb17ab755&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6334105 Jan 05 15:02:29.534893 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46428) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:29.627879 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c3e5-b5d9-4a27-aa8a-af54708930e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.650974 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c3e5-b5d9-4a27-aa8a-af54708930e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.711698 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210'}], 'enable_snat': True}, 'gw_port_id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:02:25Z', 'revision_number': 4, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port': {'id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2a:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:21Z', 'updated_at': '2022-01-05T15:02:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '6f356e12-c763-4764-a58c-8fbea3babcad', 'name': '', 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'mac_address': 'fa:16:3e:ea:52:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_interface', 'standard_attr_id': 372, 'fixed_ips': [{'subnet_id': '7f49c491-a2a8-42a7-95de-10fbdafda631', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:25Z', 'updated_at': '2022-01-05T15:02:26Z', 'revision_number': 2, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'subnets': [{'id': '7f49c491-a2a8-42a7-95de-10fbdafda631', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:29.775099 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Checking router: 91b221f6-566d-474c-8811-df9475b6ebfe for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:02:29.775938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Updating router 91b221f6-566d-474c-8811-df9475b6ebfe port 6f356e12-c763-4764-a58c-8fbea3babcad binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:02:29.831782 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.869858 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c3e5-b5d9-4a27-aa8a-af54708930e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.874015 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cdd3c3e5-b5d9-4a27-aa8a-af54708930e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:29.875599 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-cdd3c3e5-b5d9-4a27-aa8a-af54708930e2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/92e34978-a4e4-4007-bdbe-5329d59f6793 HTTP/1.1" status: 204 len: 168 time: 0.3452678 Jan 05 15:02:29.929920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdd3c3e5-b5d9-4a27-aa8a-af54708930e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92e34978-a4e4-4007-bdbe-5329d59f6793,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:30.107304 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device e4a8a036-11d1-4e94-99b6-cd4135f12991 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:30.550493 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:30.587861 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port e4a8a036-11d1-4e94-99b6-cd4135f12991 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:30.588518 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:30.798882 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e699b-621a-4582-930d-db1f728e318b req-2b0cb2d1-bd94-478e-ba1c-ad5e99cb1974 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:30.801798 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-386e699b-621a-4582-930d-db1f728e318b req-2b0cb2d1-bd94-478e-ba1c-ad5e99cb1974 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.1111209 Jan 05 15:02:30.858679 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:30.868938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c900f6cb-ee12-458b-9ad4-f6de0646f229 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:30.969387 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-386e699b-621a-4582-930d-db1f728e318b req-0ba12158-d626-4db8-971f-cfa348fcd3ba tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1569221 Jan 05 15:02:31.159110 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46444) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:31.177099 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.281107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b31009-44ae-4c2d-9953-2d850ff2fd37 req-3381d765-656e-4a2b-8fb5-84025b4b19a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:31.297768 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-05b31009-44ae-4c2d-9953-2d850ff2fd37 req-3381d765-656e-4a2b-8fb5-84025b4b19a3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.2014141 Jan 05 15:02:31.332255 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.401153 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.415969 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4243f6af-be13-4780-b089-d2ef3a28e640 None None] Pushing event updated for resources: {'Port': ['ID=6f356e12-c763-4764-a58c-8fbea3babcad,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:31.443712 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Attempting to bind port 6f356e12-c763-4764-a58c-8fbea3babcad on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:02:31.445652 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Attempting to bind port 6f356e12-c763-4764-a58c-8fbea3babcad by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:02:31.446368 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Attempting to bind port 6f356e12-c763-4764-a58c-8fbea3babcad on network 7441d551-57f6-41fa-83f4-a4a20584abd5 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:02:31.456712 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0079531-5d01-4096-ae1a-a81a67345639,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:31.464062 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:02:31.464942 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Checking segment: {'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:31.465980 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.466619 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Bound using segment: {'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:02:31.468109 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Bound port: 6f356e12-c763-4764-a58c-8fbea3babcad, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5fc64c84-d896-467c-ad80-83d994431561', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:02:31.468869 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.484592 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-05b31009-44ae-4c2d-9953-2d850ff2fd37 req-fba75a55-e501-41a9-93e6-f3d6f52706b3 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1834826 Jan 05 15:02:31.491795 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.492150 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.492491 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.493014 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.493548 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.494043 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.494539 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.495208 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.495788 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.496260 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.496870 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.497394 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.502548 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:02:31.522466 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46446) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:31.523586 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-dca20246-888e-47b0-a0f0-c190e26b8382 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b5b31bc2e59f43aab49a1fc136823a2e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3632324 Jan 05 15:02:31.567733 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-507ea0f5-79b0-480b-8e2c-61539ecdc55c None None] Provisioning complete for port 6f356e12-c763-4764-a58c-8fbea3babcad triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:31.568265 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-507ea0f5-79b0-480b-8e2c-61539ecdc55c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.608388 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] For port 6f356e12-c763-4764-a58c-8fbea3babcad, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:02:31.639110 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] For port 6f356e12-c763-4764-a58c-8fbea3babcad, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6f356e12-c763-4764-a58c-8fbea3babcad,segment=NetworkSegment(5fc64c84-d896-467c-ad80-83d994431561),segment_id=5fc64c84-d896-467c-ad80-83d994431561)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:02:31.641790 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-507ea0f5-79b0-480b-8e2c-61539ecdc55c None None] Port 6f356e12-c763-4764-a58c-8fbea3babcad cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:02:31.648637 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6ee56360-9bb6-4f30-93a2-9de5a933a47a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.680139 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6ee56360-9bb6-4f30-93a2-9de5a933a47a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.721627 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.846448 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4243f6af-be13-4780-b089-d2ef3a28e640 None None] Pushing event updated for resources: {'Port': ['ID=6f356e12-c763-4764-a58c-8fbea3babcad,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:31.866041 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Routers {'91b221f6-566d-474c-8811-df9475b6ebfe'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:31.867312 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['91b221f6-566d-474c-8811-df9475b6ebfe'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:31.869932 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6ee56360-9bb6-4f30-93a2-9de5a933a47a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.873964 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-6ee56360-9bb6-4f30-93a2-9de5a933a47a admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:31.875661 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-6ee56360-9bb6-4f30-93a2-9de5a933a47a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d0079531-5d01-4096-ae1a-a81a67345639 HTTP/1.1" status: 204 len: 168 time: 0.3517172 Jan 05 15:02:31.896863 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee56360-9bb6-4f30-93a2-9de5a933a47a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0079531-5d01-4096-ae1a-a81a67345639,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:31.967255 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:02:32.151537 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:32.185833 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] Set router 91b221f6-566d-474c-8811-df9475b6ebfe gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:32.219791 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0de87c8-8712-484c-8eb9-919b1b8191e5 req-0a2b2448-1c54-475b-acef-5ff816b10cf2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:32.228822 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a0de87c8-8712-484c-8eb9-919b1b8191e5 req-0a2b2448-1c54-475b-acef-5ff816b10cf2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0837374 Jan 05 15:02:32.323029 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a0de87c8-8712-484c-8eb9-919b1b8191e5 req-5e3b59b4-5b0b-4623-a285-49b6d16f72d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0914230 Jan 05 15:02:32.376045 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-4a9e2a71-e305-4581-bb3e-231eb37e31fc None None] Provisioning complete for port 6f356e12-c763-4764-a58c-8fbea3babcad triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:32.382209 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4a9e2a71-e305-4581-bb3e-231eb37e31fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:32.445256 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-5c194ff8-7d16-4385-96d8-40ec9b66d1bd service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0647886 Jan 05 15:02:32.586419 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4a9e2a71-e305-4581-bb3e-231eb37e31fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:32.688078 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210'}], 'enable_snat': True}, 'gw_port_id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:02:25Z', 'revision_number': 4, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port': {'id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2a:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:21Z', 'updated_at': '2022-01-05T15:02:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '6f356e12-c763-4764-a58c-8fbea3babcad', 'name': '', 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'mac_address': 'fa:16:3e:ea:52:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_interface', 'standard_attr_id': 372, 'fixed_ips': [{'subnet_id': '7f49c491-a2a8-42a7-95de-10fbdafda631', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:25Z', 'updated_at': '2022-01-05T15:02:31Z', 'revision_number': 4, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'subnets': [{'id': '7f49c491-a2a8-42a7-95de-10fbdafda631', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:32.691698 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-4a9e2a71-e305-4581-bb3e-231eb37e31fc None None] For port 6f356e12-c763-4764-a58c-8fbea3babcad, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6f356e12-c763-4764-a58c-8fbea3babcad,segment=NetworkSegment(5fc64c84-d896-467c-ad80-83d994431561),segment_id=5fc64c84-d896-467c-ad80-83d994431561)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:32.729157 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-578b64cb-5576-4af6-987c-c93a441b7f96 None None] The sync data for ids ['91b221f6-566d-474c-8811-df9475b6ebfe'] in dv-cinder-master-3-iscsi is: [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210'}], 'enable_snat': True}, 'gw_port_id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:02:25Z', 'revision_number': 4, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port': {'id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2a:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:21Z', 'updated_at': '2022-01-05T15:02:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '6f356e12-c763-4764-a58c-8fbea3babcad', 'name': '', 'network_id': '7441d551-57f6-41fa-83f4-a4a20584abd5', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'mac_address': 'fa:16:3e:ea:52:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_interface', 'standard_attr_id': 372, 'fixed_ips': [{'subnet_id': '7f49c491-a2a8-42a7-95de-10fbdafda631', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:25Z', 'updated_at': '2022-01-05T15:02:31Z', 'revision_number': 4, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'subnets': [{'id': '7f49c491-a2a8-42a7-95de-10fbdafda631', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:02:32.744719 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:32.778183 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4a9e2a71-e305-4581-bb3e-231eb37e31fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:32.782187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36078416-3adc-4880-adce-0890db1c4330 req-4ca1d642-880c-4333-88fc-9db826177850 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:32.798077 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-36078416-3adc-4880-adce-0890db1c4330 req-4ca1d642-880c-4333-88fc-9db826177850 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.2062316 Jan 05 15:02:32.912312 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-c777db9c-ad5a-406e-9685-1f3e4ad3a3c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:32.915888 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-c777db9c-ad5a-406e-9685-1f3e4ad3a3c4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 1098 time: 0.2782052 Jan 05 15:02:32.926719 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9e2a71-e305-4581-bb3e-231eb37e31fc None None] Pushing event updated for resources: {'Port': ['ID=6f356e12-c763-4764-a58c-8fbea3babcad,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:33.056079 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-36078416-3adc-4880-adce-0890db1c4330 req-d989bcd4-075b-4346-b63f-69a74f609a18 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2569880 Jan 05 15:02:33.173526 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-de8472ad-9419-432b-8ee3-60bb17daa3c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:33.175045 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-de8472ad-9419-432b-8ee3-60bb17daa3c3 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 911 time: 0.2229056 Jan 05 15:02:33.272907 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-4e705e4d-485d-4fd7-9fcc-e38b14485736 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2886de19-8aa3-470c-a593-9381bdb36ca0 HTTP/1.1" status: 200 len: 1000 time: 0.0897496 Jan 05 15:02:33.389625 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-cacd4182-42da-4b6f-9132-3e0f75a8805a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:33.392061 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-cacd4182-42da-4b6f-9132-3e0f75a8805a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 200 len: 849 time: 0.0869591 Jan 05 15:02:33.515432 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-4bbd95a9-42ee-4bec-9b5c-90f65ce9bb06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:33.521155 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-4bbd95a9-42ee-4bec-9b5c-90f65ce9bb06 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fb7bcda7-5039-4d82-bf68-12c9acc8a744&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1170521 Jan 05 15:02:33.549409 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:33.578439 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01dabb7a-b215-4034-8336-77b1b58e3c47 req-97c92a7b-2a99-4f92-9c9f-5176d25d141a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:33.580194 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-01dabb7a-b215-4034-8336-77b1b58e3c47 req-97c92a7b-2a99-4f92-9c9f-5176d25d141a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0906527 Jan 05 15:02:33.708327 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-01dabb7a-b215-4034-8336-77b1b58e3c47 req-a2890338-434d-4cfa-b5ff-b1adb174d7e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1137171 Jan 05 15:02:33.733432 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-8952443c-47c9-4716-9306-757d498647c2 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2026365 Jan 05 15:02:33.893882 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ed6067f3-fb16-4f0b-84cb-b1ce2e274a2c req-71044d3b-d920-4890-838f-5c61f9a00dd7 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1505332 Jan 05 15:02:34.049503 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6f356e12-c763-4764-a58c-8fbea3babcad up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:34.147183 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 6f356e12-c763-4764-a58c-8fbea3babcad triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:34.149744 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:34.396650 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680951b0-7997-4879-8fa5-28a54675dfb9 req-3f352d2c-9e72-405e-a57f-42f4eabc1dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:34.398355 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-680951b0-7997-4879-8fa5-28a54675dfb9 req-3f352d2c-9e72-405e-a57f-42f4eabc1dd1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.1755853 Jan 05 15:02:34.498860 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-680951b0-7997-4879-8fa5-28a54675dfb9 req-c58ec465-4afd-4b01-8add-1d496f393cd5 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0935965 Jan 05 15:02:34.504073 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:35.070506 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff999765-4ef4-4c3c-ba92-be39a0f33999 req-7eef08c2-1a4f-480f-bf70-17e7ca359803 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:35.073185 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ff999765-4ef4-4c3c-ba92-be39a0f33999 req-7eef08c2-1a4f-480f-bf70-17e7ca359803 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.1156156 Jan 05 15:02:35.186616 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ff999765-4ef4-4c3c-ba92-be39a0f33999 req-7d4299ca-89ec-4dbc-98a4-5381805c2aff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1055050 Jan 05 15:02:35.582975 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-ec4c9b1d-79b3-4fd9-8ff5-6a65098cf693 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:35.584481 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-ec4c9b1d-79b3-4fd9-8ff5-6a65098cf693 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.1538203 Jan 05 15:02:35.841869 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7afabc6-2251-4991-a7e0-61e577e83bee req-c8c4cf4d-6020-4a5c-a71f-6347c2131897 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:35.852586 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d7afabc6-2251-4991-a7e0-61e577e83bee req-c8c4cf4d-6020-4a5c-a71f-6347c2131897 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 946 time: 0.1806512 Jan 05 15:02:35.901743 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Deleting port 94077c14-de44-48f3-8ca4-3b1be238b708 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:02:35.902114 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:36.278500 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d7afabc6-2251-4991-a7e0-61e577e83bee req-e19887ff-009f-40de-99fd-67ce4cbc276e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4245453 Jan 05 15:02:36.286042 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] For port 94077c14-de44-48f3-8ca4-3b1be238b708, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=94077c14-de44-48f3-8ca4-3b1be238b708,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:36.286692 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:36.300313 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling delete_port for 94077c14-de44-48f3-8ca4-3b1be238b708 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:02:36.457380 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 req-b605d021-0c89-4fec-899d-d54a519c0aff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:36.474695 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 req-b605d021-0c89-4fec-899d-d54a519c0aff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.1179028 Jan 05 15:02:36.565584 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a17b7113-bc3d-4420-9644-f79b7e8cedc9 req-2a5d5f12-f00f-4875-b4cf-fa460a5dfd0f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0899425 Jan 05 15:02:36.614064 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:36.651227 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Pushing event deleted for resources: {'Port': ['ID=94077c14-de44-48f3-8ca4-3b1be238b708,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:36.667913 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['7e97ea9f-9968-4d12-a26d-c48d64741cea'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:02:36.723500 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] No DVR routers for this DVR port 94077c14-de44-48f3-8ca4-3b1be238b708 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:02:36.726502 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:36.731158 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-efc88a6a-750c-4cee-9e56-70cb784b11ab req-f7491a7d-dc53-4ace-a769-4321522b081b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "DELETE /v2.0/ports/94077c14-de44-48f3-8ca4-3b1be238b708 HTTP/1.1" status: 204 len: 173 time: 1.1190772 Jan 05 15:02:36.731763 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'name': 'network-vif-deleted', 'tag': '94077c14-de44-48f3-8ca4-3b1be238b708'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:02:36.734134 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b74b48a7-e4c9-4787-86fb-5730fb271c0d" -d '{"events": [{"server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "name": "network-vif-deleted", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:02:36.769913 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:02:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d x-openstack-request-id: req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:02:36.770273 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "67f4ef43-fb41-48ea-a380-e03f6fccf9c5", "name": "network-vif-deleted", "tag": "94077c14-de44-48f3-8ca4-3b1be238b708", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:02:36.770588 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d5cb8fdf-6431-4150-8665-dfd2f54bf52d {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:02:36.771046 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67f4ef43-fb41-48ea-a380-e03f6fccf9c5', 'name': 'network-vif-deleted', 'tag': '94077c14-de44-48f3-8ca4-3b1be238b708', 'status': 'completed', 'code': 200} Jan 05 15:02:37.399161 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-008f28e7-7c6f-49e7-8a67-4ca48c4c8104 req-80daf72e-a198-4063-a5ae-56f8af0d9d8e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.0530922 Jan 05 15:02:37.788853 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f8a406-185b-495c-90cf-b87ffff75228 req-126d6539-6e9d-44f9-925a-15b71e0e063a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:37.795796 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-33f8a406-185b-495c-90cf-b87ffff75228 req-126d6539-6e9d-44f9-925a-15b71e0e063a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0878923 Jan 05 15:02:37.853979 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-33f8a406-185b-495c-90cf-b87ffff75228 req-2d852994-d56d-4c03-9951-dcfc44eb7dd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571473 Jan 05 15:02:38.363325 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 94077c14-de44-48f3-8ca4-3b1be238b708 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:02:38.422882 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 94077c14-de44-48f3-8ca4-3b1be238b708 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:02:38.423416 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 94077c14-de44-48f3-8ca4-3b1be238b708 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:02:38.551327 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-eefeb297-e2a7-49ce-995b-a19fe7d70a92 req-205b9282-f9fd-407e-a249-9e9056bfb64c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.0427506 Jan 05 15:02:39.082846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf702fc-1425-4e3e-8422-b14f32d97756 req-1f4369e7-9895-4584-98f9-e1d5e4344931 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:39.085503 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fbf702fc-1425-4e3e-8422-b14f32d97756 req-1f4369e7-9895-4584-98f9-e1d5e4344931 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0693769 Jan 05 15:02:39.189217 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fbf702fc-1425-4e3e-8422-b14f32d97756 req-3dfed2a3-0270-4d3d-b74c-fc27859e05b9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0968497 Jan 05 15:02:39.682715 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5b188371-47b8-49f3-8e5f-778f0f636710 req-7d10aacc-ca9e-4efe-86df-98b95d72d1ea tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.0452311 Jan 05 15:02:40.308828 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e32bb38a-e369-430a-9563-975b490fd414 req-d61445aa-32e6-4000-9661-3c7d035b59d8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:40.310473 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e32bb38a-e369-430a-9563-975b490fd414 req-d61445aa-32e6-4000-9661-3c7d035b59d8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0480454 Jan 05 15:02:40.358848 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e32bb38a-e369-430a-9563-975b490fd414 req-60b1f641-ef26-49db-b0af-df1579b24e0c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427959 Jan 05 15:02:40.839396 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-55f22358-7e58-4b0a-a330-98ed7009c119 req-f8dcb801-3937-4a86-8e9a-ca7a14cbc92b tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.0450752 Jan 05 15:02:41.531453 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2792bc-537f-4951-92c1-d7f3915ab619 req-6e250d38-be8f-43f6-b01a-826c27ef13b4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:41.541777 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f2792bc-537f-4951-92c1-d7f3915ab619 req-6e250d38-be8f-43f6-b01a-826c27ef13b4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0826411 Jan 05 15:02:41.600330 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f2792bc-537f-4951-92c1-d7f3915ab619 req-bb02118d-420c-4faa-ba87-226dcc9bdabb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573068 Jan 05 15:02:41.946437 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-57577bca-e97b-4bec-b504-6069d324f757 req-0e1bf898-b197-4eb7-bb43-4bfd19475a14 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=67f4ef43-fb41-48ea-a380-e03f6fccf9c5 HTTP/1.1" status: 200 len: 210 time: 0.0283334 Jan 05 15:02:42.785250 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfeeb88e-3459-496e-857f-30e02f76606d req-eac43c71-04c0-4ff7-8b5b-ec87d0fc2268 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:42.787675 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dfeeb88e-3459-496e-857f-30e02f76606d req-eac43c71-04c0-4ff7-8b5b-ec87d0fc2268 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0813198 Jan 05 15:02:42.930582 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dfeeb88e-3459-496e-857f-30e02f76606d req-990d4059-3beb-4141-80fe-37652c0371dc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1327877 Jan 05 15:02:44.016994 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 req-11800801-b4b0-4dc1-b8d1-97cb0ef1843e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:44.031334 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 req-11800801-b4b0-4dc1-b8d1-97cb0ef1843e tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.1066895 Jan 05 15:02:44.097423 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4c5a3a48-4e43-4968-b1cf-a99bb4b19109 req-d706acf9-c8a0-48a3-a967-ee004a3bdf04 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648654 Jan 05 15:02:44.224456 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a933b413-d74f-4659-9dcb-166416914d7b req-6cf6b8e0-fb5e-4d82-a212-09d6285b82bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:44.226747 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a933b413-d74f-4659-9dcb-166416914d7b req-6cf6b8e0-fb5e-4d82-a212-09d6285b82bb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0638733 Jan 05 15:02:44.278079 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a933b413-d74f-4659-9dcb-166416914d7b req-ea18a42d-0910-42c3-aa90-91edf4b8a2a2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452850 Jan 05 15:02:45.251618 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9de76d-c65e-4450-a427-9a94610f3431 req-6834589c-01ea-458c-b308-8548769cfef1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:45.253877 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ec9de76d-c65e-4450-a427-9a94610f3431 req-6834589c-01ea-458c-b308-8548769cfef1 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0543489 Jan 05 15:02:45.327830 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ec9de76d-c65e-4450-a427-9a94610f3431 req-db7ba243-1944-46ad-95d2-91f5d0092944 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631752 Jan 05 15:02:45.472337 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57848534-2805-4e94-b47a-4c5c38498f69 req-293a8d2d-d4eb-44c9-ada5-9c944fbfe5ca tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:45.483105 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-57848534-2805-4e94-b47a-4c5c38498f69 req-293a8d2d-d4eb-44c9-ada5-9c944fbfe5ca tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0759914 Jan 05 15:02:45.561579 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-57848534-2805-4e94-b47a-4c5c38498f69 req-f06a20ff-5536-4e86-b476-5c4ebc1353a8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0797217 Jan 05 15:02:46.479180 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 req-c95aaa2c-3256-413d-ad89-8d074baa1f6c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:46.481754 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 req-c95aaa2c-3256-413d-ad89-8d074baa1f6c tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0634272 Jan 05 15:02:46.557623 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fa2f99cf-9a29-4a77-b2fc-eb6cd4911167 req-aa26d8db-752f-421f-9b7c-efc104b8c8ca tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565891 Jan 05 15:02:46.706078 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 req-fb96fced-a4c8-425c-9c12-1dd1185c4d98 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:46.712448 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 req-fb96fced-a4c8-425c-9c12-1dd1185c4d98 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0529747 Jan 05 15:02:46.764147 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c169f833-df19-4dcb-b8ae-862be1d5e2d9 req-74fcf2f3-5ee8-4c53-9093-98bbf9f775fa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483937 Jan 05 15:02:47.699541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f req-cdca67eb-850a-46f5-9461-316f5c9bab34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:47.700958 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f req-cdca67eb-850a-46f5-9461-316f5c9bab34 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0596306 Jan 05 15:02:47.750799 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c9347bf9-119b-4fdc-9a09-3030a0dcb65f req-d29f103d-712f-45ff-bce6-a5063ffbebf7 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443699 Jan 05 15:02:47.859537 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4814f12e-1999-4e21-acc8-6630c3aaed3e req-a83fa535-efc7-46cd-a805-64718306d6b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:47.861028 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4814f12e-1999-4e21-acc8-6630c3aaed3e req-a83fa535-efc7-46cd-a805-64718306d6b0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0508695 Jan 05 15:02:47.893449 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 req-533c9d9d-c0b1-4f49-a763-9d3bc8815e51 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:47.894927 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 req-533c9d9d-c0b1-4f49-a763-9d3bc8815e51 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0585413 Jan 05 15:02:47.911682 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4814f12e-1999-4e21-acc8-6630c3aaed3e req-e0088e36-56a5-4c3f-888a-d0fb8ef8ccde tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447996 Jan 05 15:02:47.958004 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-65bd0e7c-be81-4f4f-acc7-cf3ac7d38743 req-5680853c-7ea2-4f8d-aefd-164afd93fd30 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573583 Jan 05 15:02:48.880517 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef516f91-9ce0-4202-a886-fb10eee17cfb req-ac3b285f-4e29-49c7-b2e9-b3ff588957df tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:48.882257 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ef516f91-9ce0-4202-a886-fb10eee17cfb req-ac3b285f-4e29-49c7-b2e9-b3ff588957df tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0559819 Jan 05 15:02:48.933733 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ef516f91-9ce0-4202-a886-fb10eee17cfb req-77dea1c0-df3d-4707-9fe6-ea889e64a267 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/security-groups?id=2aae8d23-92a7-4bb0-acdc-7a19b112309f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447249 Jan 05 15:02:49.074818 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e161372a-0e34-4b91-a6a9-301cfaa68e19 req-02a564d6-ab83-4fce-8d2a-1103ee4a14aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:49.076486 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e161372a-0e34-4b91-a6a9-301cfaa68e19 req-02a564d6-ab83-4fce-8d2a-1103ee4a14aa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0578554 Jan 05 15:02:49.154212 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e161372a-0e34-4b91-a6a9-301cfaa68e19 req-2718f373-f4ea-4ad4-9a18-dc6c6f5915fa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708332 Jan 05 15:02:49.193491 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 req-5d86c44c-a2cc-418c-8591-8bc4006e3649 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:49.195434 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 req-5d86c44c-a2cc-418c-8591-8bc4006e3649 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0879312 Jan 05 15:02:49.245382 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-de3d7a9a-d989-4135-bfe9-0e28ff3a7ae5 req-3660c297-e513-46f4-aba3-a74ced6e42ae tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442173 Jan 05 15:02:49.466650 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-c57127c7-7f38-42c4-af72-184f53ab8841 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:49.468297 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-c57127c7-7f38-42c4-af72-184f53ab8841 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 945 time: 0.0576854 Jan 05 15:02:49.571070 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Deleting port 7e97ea9f-9968-4d12-a26d-c48d64741cea {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:02:49.571930 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:49.691645 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] For port 7e97ea9f-9968-4d12-a26d-c48d64741cea, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=7e97ea9f-9968-4d12-a26d-c48d64741cea,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:49.692129 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:49.706180 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Calling delete_port for 7e97ea9f-9968-4d12-a26d-c48d64741cea owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:02:49.949276 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:49.983502 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Pushing event deleted for resources: {'Port': ['ID=7e97ea9f-9968-4d12-a26d-c48d64741cea,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:49.988296 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['7e97ea9f-9968-4d12-a26d-c48d64741cea'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:02:50.037026 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] No DVR routers for this DVR port 7e97ea9f-9968-4d12-a26d-c48d64741cea on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:02:50.040905 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:50.046938 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8e3d8d8e-c83d-4ac0-9ca8-ed84b6ffe6e1 req-8b25b510-cbf2-4884-9ef1-bfe7bba26dfc tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.13 "DELETE /v2.0/ports/7e97ea9f-9968-4d12-a26d-c48d64741cea HTTP/1.1" status: 204 len: 173 time: 0.5723305 Jan 05 15:02:50.047665 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'name': 'network-vif-deleted', 'tag': '7e97ea9f-9968-4d12-a26d-c48d64741cea'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:02:50.050778 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95d08d7a-46a8-4fc8-96bb-c52a8d224a7b" -d '{"events": [{"server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "name": "network-vif-deleted", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:02:50.102222 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a1213a15-b818-4d84-8c08-a2256da48c81 req-3474c258-a621-4085-a6b6-385af2fd0598 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 210 time: 0.0481558 Jan 05 15:02:50.113101 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:02:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f177eee-9c06-44b6-a632-6a6529388325 x-openstack-request-id: req-7f177eee-9c06-44b6-a632-6a6529388325 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:02:50.120206 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e27001d-6fb2-4283-b4e6-19f0aec6d3cb", "name": "network-vif-deleted", "tag": "7e97ea9f-9968-4d12-a26d-c48d64741cea", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:02:50.120206 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7f177eee-9c06-44b6-a632-6a6529388325 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:02:50.120206 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e27001d-6fb2-4283-b4e6-19f0aec6d3cb', 'name': 'network-vif-deleted', 'tag': '7e97ea9f-9968-4d12-a26d-c48d64741cea', 'status': 'completed', 'code': 200} Jan 05 15:02:50.308904 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c0f606-b8f2-4692-a7af-9134929b3902 req-ee41205b-462b-4e3c-b369-93fccb434df3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:50.311108 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c0c0f606-b8f2-4692-a7af-9134929b3902 req-ee41205b-462b-4e3c-b369-93fccb434df3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0679367 Jan 05 15:02:50.417610 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:02:50.436214 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c0c0f606-b8f2-4692-a7af-9134929b3902 req-d397a739-1acc-4488-ba34-5b317d888c8c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1143975 Jan 05 15:02:50.461968 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1205764-8126-4fc9-855a-3ff6e4903217 req-50bcce98-8166-443a-ad34-a39803149e03 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:50.463694 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c1205764-8126-4fc9-855a-3ff6e4903217 req-50bcce98-8166-443a-ad34-a39803149e03 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 944 time: 0.0969741 Jan 05 15:02:50.597895 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c1205764-8126-4fc9-855a-3ff6e4903217 req-a1db522c-83dd-44ba-b6f3-6df89a104c88 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0948377 Jan 05 15:02:50.598104 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:50.605093 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '45483c3c-9f42-4aff-a962-22ff36647afc', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'port_id': '45483c3c-9f42-4aff-a962-22ff36647afc', 'mac_address': 'fa:16:3e:25:44:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:02:50.678511 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:50.701486 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 45483c3c-9f42-4aff-a962-22ff36647afc {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:02:50.726797 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:50.787459 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:50.848008 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=9']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:50.887062 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46792) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:50.945110 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_v2 [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] Deleting subnet 381a404c-2b76-4214-b59d-06022483de49 {{(pid=114654) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:02:50.945110 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:50.997698 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8770652'] for subnet, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.042415 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.071843 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46796) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:51.082798 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['45483c3c-9f42-4aff-a962-22ff36647afc'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:02:51.203845 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0fffac5b-57b0-42d7-9ae9-bf71e1d4221f admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.232590 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-150dab1b-5bc6-4015-b79d-aa53049a2987 req-c0b374bb-52b6-4d6c-9f82-5a3b6d53ed39 tempest-ServerRescueNegativeTestJSON-1374977121 tempest-ServerRescueNegativeTestJSON-1374977121-project] 10.222.0.30 "GET /v2.0/ports?device_id=2e27001d-6fb2-4283-b4e6-19f0aec6d3cb HTTP/1.1" status: 200 len: 210 time: 0.0346956 Jan 05 15:02:51.282361 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0fffac5b-57b0-42d7-9ae9-bf71e1d4221f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.492628 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0fffac5b-57b0-42d7-9ae9-bf71e1d4221f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.493690 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8855717', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8833888'] for subnet, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.528214 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=381a404c-2b76-4214-b59d-06022483de49,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:51.531541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fffac5b-57b0-42d7-9ae9-bf71e1d4221f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98a6f538-4321-4418-9435-ba0f140d45fa,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:51.534436 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.537658 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-0fffac5b-57b0-42d7-9ae9-bf71e1d4221f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=96bba18706b54ff2b7732851a9b8de25&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4647186 Jan 05 15:02:51.538622 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7c2105bc-99b0-4d52-8316-1ea716a7e557 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/381a404c-2b76-4214-b59d-06022483de49 HTTP/1.1" status: 204 len: 168 time: 0.6501672 Jan 05 15:02:51.540119 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46804) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:51.543112 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46806) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:51.627067 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.631105 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8966039d-f96e-4485-b5d1-4b4463bf2ee6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.643930 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7421b434-e4f4-4ac1-8869-b1607cfd5053 req-d82d9915-57ab-473b-a860-2b0d3fbc186b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:51.645577 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7421b434-e4f4-4ac1-8869-b1607cfd5053 req-d82d9915-57ab-473b-a860-2b0d3fbc186b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0845320 Jan 05 15:02:51.680578 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8966039d-f96e-4485-b5d1-4b4463bf2ee6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.736087 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7421b434-e4f4-4ac1-8869-b1607cfd5053 req-ea18e032-fea9-44c6-96f2-5b18805962d4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0813189 Jan 05 15:02:51.753257 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.768577 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 req-2a2a29eb-ad8b-4746-8e44-70c61a889cc3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:51.770200 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 req-2a2a29eb-ad8b-4746-8e44-70c61a889cc3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 945 time: 0.1286187 Jan 05 15:02:51.791434 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aec55d3c-7bde-4a3f-bf24-eddde8e56c38']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:51.812359 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '52b64191-c846-4aa1-bf19-9e627b802773') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:51.812657 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '52b64191-c846-4aa1-bf19-9e627b802773') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:51.824336 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.851038 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.859510 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4f27ee74-0c75-4a1b-bbd0-bdd5b4770d74 req-ff2e5d19-8713-4835-999c-c2ea3184fd7e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0833168 Jan 05 15:02:51.862259 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:02:51.862807 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.864509 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:02:51.866961 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:02:51.886258 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8966039d-f96e-4485-b5d1-4b4463bf2ee6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.888857 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8966039d-f96e-4485-b5d1-4b4463bf2ee6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:51.893558 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-8966039d-f96e-4485-b5d1-4b4463bf2ee6 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/98a6f538-4321-4418-9435-ba0f140d45fa HTTP/1.1" status: 204 len: 168 time: 0.3488350 Jan 05 15:02:51.899554 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8966039d-f96e-4485-b5d1-4b4463bf2ee6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98a6f538-4321-4418-9435-ba0f140d45fa,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:52.029482 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.050557 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.053720 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] 10.222.0.30 "DELETE /v2.0/networks/aec55d3c-7bde-4a3f-bf24-eddde8e56c38 HTTP/1.1" status: 204 len: 168 time: 0.5095630 Jan 05 15:02:52.054657 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f938ee7-a55a-4922-9de4-826a0d4437a1 admin admin] Pushing event deleted for resources: {'Network': ['ID=aec55d3c-7bde-4a3f-bf24-eddde8e56c38,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:52.312655 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46828) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:52.439793 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:52.536524 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46832) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:52.539169 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 45483c3c-9f42-4aff-a962-22ff36647afc triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:52.539657 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.602332 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-05a6493e-08db-4b8d-a222-436b8375a1ab admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e785ec07120a4184acdbf74f73489ce8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0641127 Jan 05 15:02:52.605868 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46834) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:52.670376 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c5de-a195-4f5b-a6c8-14e1b8688632 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.680960 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.707776 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:02:52.710404 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9af84edc-9585-4281-9511-51f2fd194b9f" -d '{"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:02:52.726327 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:52.731099 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c5de-a195-4f5b-a6c8-14e1b8688632 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.807461 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:02:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c426a60a-315a-419e-a6a6-be115ee2792f x-openstack-request-id: req-c426a60a-315a-419e-a6a6-be115ee2792f {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:02:52.807831 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-plugged", "status": "completed", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:02:52.808115 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c426a60a-315a-419e-a6a6-be115ee2792f {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:02:52.808800 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc', 'code': 200} Jan 05 15:02:52.840132 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.902054 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c5de-a195-4f5b-a6c8-14e1b8688632 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.906870 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c5de-a195-4f5b-a6c8-14e1b8688632 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:52.910613 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-9aa8c5de-a195-4f5b-a6c8-14e1b8688632 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/74d864e5-10ed-40c0-b4fe-005a3392fae4 HTTP/1.1" status: 204 len: 168 time: 0.3042583 Jan 05 15:02:52.925985 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aa8c5de-a195-4f5b-a6c8-14e1b8688632 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74d864e5-10ed-40c0-b4fe-005a3392fae4,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:52.999369 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=10']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:53.029039 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d06918d-d3c7-4f83-b813-76007ceb6f29 req-19e52555-fbf3-4625-996a-89e80653f155 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:53.031865 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0d06918d-d3c7-4f83-b813-76007ceb6f29 req-19e52555-fbf3-4625-996a-89e80653f155 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.1758680 Jan 05 15:02:53.100353 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680a3f1b-f7f5-40bc-9291-17762befdc1b req-510027ab-5199-4079-a0bd-03058d2c76b6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:53.102231 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-680a3f1b-f7f5-40bc-9291-17762befdc1b req-510027ab-5199-4079-a0bd-03058d2c76b6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0988908 Jan 05 15:02:53.129463 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0d06918d-d3c7-4f83-b813-76007ceb6f29 req-2c52b990-e75a-4f00-bbc6-b08acffeae79 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717316 Jan 05 15:02:53.146140 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.224801 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-680a3f1b-f7f5-40bc-9291-17762befdc1b req-dba69d89-b115-490c-bcea-e0c52de66a01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1134276 Jan 05 15:02:53.305141 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46854) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:53.562342 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-746329903-network', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:53.576229 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42483f8a-8a18-4924-a346-322ae9e9122c req-e0beb2f6-6177-4e1e-846e-33a04b0bc64b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:53.578341 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-42483f8a-8a18-4924-a346-322ae9e9122c req-e0beb2f6-6177-4e1e-846e-33a04b0bc64b service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1100 time: 0.0900025 Jan 05 15:02:53.657029 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-42483f8a-8a18-4924-a346-322ae9e9122c req-607e1c4b-f8e9-40c4-9a03-4730192207f3 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0706720 Jan 05 15:02:53.704230 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Made reservation on behalf of c3797435200949c8a45be6c5b0525dc0 for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:02:53.706586 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.717045 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.776677 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Deleting port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:02:53.784457 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.811054 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.866849 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] For port 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,segment=NetworkSegment(837624e7-6703-4540-ba8b-9f16e4400b5c),segment_id=837624e7-6703-4540-ba8b-9f16e4400b5c)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:53.867184 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.873561 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.894870 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Calling delete_port for 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f owned by network:router_interface {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:02:53.913366 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 129} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:02:53.934606 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00de9902-df4d-480c-8886-590d11a33750,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:53.966448 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:53.967033 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Added segment fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b of type vlan for network e5205e82-a517-4157-848a-78560d0d2806 Jan 05 15:02:54.022948 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:54.204457 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:54.205573 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:54.211057 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:54.232963 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:54.323009 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Pushing event deleted for resources: {'Port': ['ID=381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:54.401566 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.0949662 Jan 05 15:02:54.419016 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fb7620-e377-4687-8fb6-f06cd2eedf0c admin admin] Pushing event updated for resources: {'Network': ['ID=e5205e82-a517-4157-848a-78560d0d2806,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:54.425412 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46882) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:54.433762 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network e5205e82-a517-4157-848a-78560d0d2806 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:02:54.446257 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Request body: {'subnet': {'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-746329903-subnet', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:54.458628 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 7e97ea9f-9968-4d12-a26d-c48d64741cea no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:02:54.520410 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05e8477-a71e-40cd-983d-088863fca891 req-44358753-d447-4e5d-8f9c-b9f4ac5e6022 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:54.522965 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d05e8477-a71e-40cd-983d-088863fca891 req-44358753-d447-4e5d-8f9c-b9f4ac5e6022 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.2294075 Jan 05 15:02:54.524470 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 7e97ea9f-9968-4d12-a26d-c48d64741cea {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:02:54.524997 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 7e97ea9f-9968-4d12-a26d-c48d64741cea not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:02:54.593799 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888191c6-ebc1-466d-9e70-661223c9fdb1 req-159cde21-aebb-48c9-8761-a0962f40ff02 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:54.597024 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-888191c6-ebc1-466d-9e70-661223c9fdb1 req-159cde21-aebb-48c9-8761-a0962f40ff02 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.2627547 Jan 05 15:02:54.622083 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d05e8477-a71e-40cd-983d-088863fca891 req-f500c0bc-481d-49a6-8cc4-75b064100257 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0654931 Jan 05 15:02:54.644263 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Made reservation on behalf of c3797435200949c8a45be6c5b0525dc0 for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:02:54.647262 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8833947'] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:54.711460 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-888191c6-ebc1-466d-9e70-661223c9fdb1 req-b6931585-97c8-4226-bf63-5ad8adf9198d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0726790 Jan 05 15:02:54.789372 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:55.046664 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8855778', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8833897'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:55.131716 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Router f934a04d-bde3-4b0d-b89f-2a4d778671c2 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:02:55.150470 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:55.182130 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Checking segment: {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:55.182645 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Network hostable DHCP agents. Network: e5205e82-a517-4157-848a-78560d0d2806, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:02:55.267764 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:02:55.275190 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-da3c47f9-bac4-4a95-9041-141b3cbb7ac3 admin admin] 10.222.0.30 "PUT /v2.0/routers/f934a04d-bde3-4b0d-b89f-2a4d778671c2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9594548 Jan 05 15:02:55.277818 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46896) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:55.279801 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] Sync routers for ids ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:02:55.292104 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] Routers {'f934a04d-bde3-4b0d-b89f-2a4d778671c2'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:55.292733 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:55.347199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Network e5205e82-a517-4157-848a-78560d0d2806 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:02:55.418552 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] Set router f934a04d-bde3-4b0d-b89f-2a4d778671c2 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:55.429422 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, e5205e82-a517-4157-848a-78560d0d2806) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:55.442528 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96b0e5f7-6621-485b-bdf2-c222475f1604 None None] Network e5205e82-a517-4157-848a-78560d0d2806 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:02:55.462305 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:55.463341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:55.525796 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks [] for router, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:55.612197 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-1aa8cbab-33e5-45d6-bde4-310e32ff0148 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 1.1695731 Jan 05 15:02:55.612419 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46906) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:55.616840 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:02:55.741104 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T15:02:54Z', 'revision_number': 5, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:55.755457 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:55.790316 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] Checking router: f934a04d-bde3-4b0d-b89f-2a4d778671c2 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:02:55.804836 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] Routers {'f934a04d-bde3-4b0d-b89f-2a4d778671c2'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:55.805826 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:55.834039 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 req-e9e4c12a-26bd-477f-8b03-4b147bf234d1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:55.836150 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 req-e9e4c12a-26bd-477f-8b03-4b147bf234d1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.1139004 Jan 05 15:02:55.868573 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e5205e82-a517-4157-848a-78560d0d2806', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 15:02:55.869364 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12951726-5cb4-4598-8d20-bc6991c8203a req-776cb3cf-3cd5-4e6a-b7b2-601cad4267a1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:55.870624 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:55.871098 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-12951726-5cb4-4598-8d20-bc6991c8203a req-776cb3cf-3cd5-4e6a-b7b2-601cad4267a1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0615456 Jan 05 15:02:55.926900 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e3f132e9-c262-4f08-a8b3-5b29d02413c8 req-45776c2a-eb71-420c-8335-1bbfe4e8d0d2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0802360 Jan 05 15:02:55.930818 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-12951726-5cb4-4598-8d20-bc6991c8203a req-b0804ac1-e05f-46aa-a338-7510a493aacc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536504 Jan 05 15:02:56.011437 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] Set router f934a04d-bde3-4b0d-b89f-2a4d778671c2 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:02:56.048919 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Allocated IP 172.20.0.2 (e5205e82-a517-4157-848a-78560d0d2806/c3f10689-3a61-4de7-8ebe-99aa4c5a6a83/ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:56.164950 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.164950 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.201985 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T15:02:54Z', 'revision_number': 5, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:56.207751 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.225848 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.236575 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80e0942f-16d3-4616-bf0f-59a32000fd62 None None] The sync data for ids ['f934a04d-bde3-4b0d-b89f-2a4d778671c2'] in dv-cinder-master-3-iscsi is: [{'id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'name': 'tempest-ServerRescueNegativeTestJSON-1098105403-router', 'tenant_id': '9c7d005c6e9e454fa506907144639917', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168'}], 'enable_snat': True}, 'gw_port_id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:23Z', 'updated_at': '2022-01-05T15:02:54Z', 'revision_number': 5, 'project_id': '9c7d005c6e9e454fa506907144639917', 'gw_port': {'id': '5a6617dc-dbb7-455d-bd98-a3b0247f9180', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:c4:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f934a04d-bde3-4b0d-b89f-2a4d778671c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:24Z', 'updated_at': '2022-01-05T14:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:02:56.322909 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Deleting port 5a6617dc-dbb7-455d-bd98-a3b0247f9180 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:02:56.323583 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.399892 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] For port 5a6617dc-dbb7-455d-bd98-a3b0247f9180, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5a6617dc-dbb7-455d-bd98-a3b0247f9180,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:56.400280 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.411602 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Calling delete_port for 5a6617dc-dbb7-455d-bd98-a3b0247f9180 owned by network:router_gateway {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:02:56.621844 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.666574 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Network e5205e82-a517-4157-848a-78560d0d2806 is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:56.670044 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:56.674086 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:56.683932 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Pushing event updated for resources: {'Port': ['ID=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:56.712703 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.747495 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Attempting to bind port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:02:56.747495 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Attempting to bind port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:02:56.747860 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Attempting to bind port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 on network e5205e82-a517-4157-848a-78560d0d2806 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:02:56.755465 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Pushing event deleted for resources: {'Port': ['ID=5a6617dc-dbb7-455d-bd98-a3b0247f9180,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:56.759752 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:02:56.760340 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Checking segment: {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:02:56.766574 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.767101 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Bound using segment: {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:02:56.767767 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Bound port: ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:02:56.768371 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.786399 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.820511 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.878384 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] For port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:02:56.882167 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] For port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:02:56.929793 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.932344 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:56.970310 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.094045 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0964c53-90c0-4811-968e-2964ad762214 req-ef65e8a1-b361-4652-800f-4d0ccefb77bd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:57.101183 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d0964c53-90c0-4811-968e-2964ad762214 req-ef65e8a1-b361-4652-800f-4d0ccefb77bd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0582225 Jan 05 15:02:57.116887 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f214c50f-722a-4529-87e6-ce396311c953 None None] Pushing event updated for resources: {'Port': ['ID=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:57.128715 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.129276 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Fanout notify agent at l3_agent the message router_deleted on router f934a04d-bde3-4b0d-b89f-2a4d778671c2 {{(pid=114654) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:02:57.142785 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.147662 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-fb7ac201-aae2-408a-936c-638d6e14d54a admin admin] 10.222.0.30 "DELETE /v2.0/routers/f934a04d-bde3-4b0d-b89f-2a4d778671c2 HTTP/1.1" status: 204 len: 168 time: 1.8686690 Jan 05 15:02:57.148508 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 46940) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:57.210237 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d0964c53-90c0-4811-968e-2964ad762214 req-b9452f1b-3b48-4bdf-8f72-ef6471d551a3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1081777 Jan 05 15:02:57.221315 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] Deleting subnet 05f78cb6-38bd-4a95-a1d0-4c4654bbd075 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:02:57.316971 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53f4257-2b01-4bb9-8e89-6fc790b82623 req-23f75ae3-0c61-4f51-9261-1fb923fd1e6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:57.324149 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f53f4257-2b01-4bb9-8e89-6fc790b82623 req-23f75ae3-0c61-4f51-9261-1fb923fd1e6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.2621906 Jan 05 15:02:57.327425 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.428831 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.458333 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.463249 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.512390 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f53f4257-2b01-4bb9-8e89-6fc790b82623 req-f5a01280-7916-4bc1-938d-d66b10851e09 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1870940 Jan 05 15:02:57.563989 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.653383 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Allocated IP 172.37.2.20 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/f52cee16-e7b4-4acc-9ce6-5dad24163904) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:02:57.789431 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.831357 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=05f78cb6-38bd-4a95-a1d0-4c4654bbd075,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:57.833361 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.836685 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d6eef55e-0f5c-410a-974e-a9df6750e634 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/05f78cb6-38bd-4a95-a1d0-4c4654bbd075 HTTP/1.1" status: 204 len: 168 time: 0.6853085 Jan 05 15:02:57.839427 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46958) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:57.841424 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:57.928137 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.041019 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.056725 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:02:58.063734 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-fd3d5c26-b83d-4b73-a212-537571e08765 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/networks?tenant_id=27614f6e32454ccaa602817f1658ac5a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0821018 Jan 05 15:02:58.065724 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.101368 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Pushing event updated for resources: {'Port': ['ID=f52cee16-e7b4-4acc-9ce6-5dad24163904,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:58.131716 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:02:58.132397 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:58.132784 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.134347 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:02:58.139623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['975fa447-11a2-47cd-86bf-82619c2a8abd']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:58.143857 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:02:58.190560 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-43e19819-afd8-4174-a071-3531671ff559 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.205847 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '837624e7-6703-4540-ba8b-9f16e4400b5c') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:58.206407 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '837624e7-6703-4540-ba8b-9f16e4400b5c') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:58.240723 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.243874 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.278311 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:02:58.293719 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.323776 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:02:58.326117 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:02:58.331686 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:02:58.344818 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.439770 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-afeaa484-c791-4f40-82c2-b6ef75fdce24 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:58.441430 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-afeaa484-c791-4f40-82c2-b6ef75fdce24 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3677061 Jan 05 15:02:58.466781 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-0acd1f98-4a39-4e37-864d-945b03b97c08 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/quotas/27614f6e32454ccaa602817f1658ac5a HTTP/1.1" status: 200 len: 375 time: 0.0153692 Jan 05 15:02:58.483213 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:02:58.502197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:58.541975 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd req-613ba3a5-6d68-4b5d-814c-b01bffc6bff9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:58.542629 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:02:58.543070 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 381a7ef4-4e8b-4ceb-bb3d-f1e2e836b95f not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:02:58.543666 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 5a6617dc-dbb7-455d-bd98-a3b0247f9180 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:02:58.544956 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd req-613ba3a5-6d68-4b5d-814c-b01bffc6bff9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0905585 Jan 05 15:02:58.572331 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 5a6617dc-dbb7-455d-bd98-a3b0247f9180 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:02:58.572818 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 5a6617dc-dbb7-455d-bd98-a3b0247f9180 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:02:58.608163 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f251c696-7ea4-4ce5-a1d3-2cbe71635dcd req-56879beb-3d1e-4629-a65b-18ae87258664 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557501 Jan 05 15:02:58.713227 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee5dab48-4ea7-426f-8f74-506090d8db06 None None] Network e5205e82-a517-4157-848a-78560d0d2806 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:02:58.755337 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.767992 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-13131261-0525-4b7f-8068-dc1bbb305475 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=27614f6e32454ccaa602817f1658ac5a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2875462 Jan 05 15:02:58.768716 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.774024 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:58.777374 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] 10.222.0.30 "DELETE /v2.0/networks/975fa447-11a2-47cd-86bf-82619c2a8abd HTTP/1.1" status: 204 len: 168 time: 0.9363081 Jan 05 15:02:58.790502 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b93149d-6ac6-48b5-9cfb-b50b1fc5bb0f admin admin] Pushing event deleted for resources: {'Network': ['ID=975fa447-11a2-47cd-86bf-82619c2a8abd,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:58.835326 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-3256403f-5946-452a-8ee9-7fa2e96d8003 None None] Provisioning complete for port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:58.835700 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3256403f-5946-452a-8ee9-7fa2e96d8003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.138461 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-300639b4-181c-4846-b3de-d452b3b35bf7 req-4bfb119c-ef49-4c76-aaf4-da1e72887960 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:59.141235 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-300639b4-181c-4846-b3de-d452b3b35bf7 req-4bfb119c-ef49-4c76-aaf4-da1e72887960 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0597472 Jan 05 15:02:59.158044 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-9c64b7a9-3dab-4239-ab12-e463fc7dc705 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:59.159542 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-9c64b7a9-3dab-4239-ab12-e463fc7dc705 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 814 time: 0.4371164 Jan 05 15:02:59.162968 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-48243f49-ef7d-474f-888f-19faba73e8fe None None] Provisioning complete for port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:02:59.164131 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-48243f49-ef7d-474f-888f-19faba73e8fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.213923 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-300639b4-181c-4846-b3de-d452b3b35bf7 req-c967f0d3-8c88-4b7c-a0da-1ab2f4a512f9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0592022 Jan 05 15:02:59.248272 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-891d505d-e92e-4ac9-8fc4-f72f4f2e4e15 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/quotas/b874b608d2c848a88541148e56d2114d HTTP/1.1" status: 200 len: 375 time: 0.0800648 Jan 05 15:02:59.297627 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-78e5eded-eb37-44d9-8793-c2a378d7c86b req-89a5fbf1-66d2-4289-a075-64376014dc3d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 210 time: 0.0369701 Jan 05 15:02:59.298294 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 46998) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:59.341737 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-670c8ba3-3f88-4ccd-acfb-6e137a467874 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0918920 Jan 05 15:02:59.353012 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f49e49a4-ceb5-45bc-83a3-5a53b1de6b1f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9c7d005c6e9e454fa506907144639917&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0533795 Jan 05 15:02:59.353753 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47000) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:59.365763 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.400589 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c230a7bd-f3f0-4f66-b347-0b4e9f2d4e64 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.423680 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c230a7bd-f3f0-4f66-b347-0b4e9f2d4e64 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.523552 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-089564d1-3765-4bed-ac8e-2dedc91f3519 service neutron] 10.222.0.30 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1656153 Jan 05 15:02:59.547487 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c230a7bd-f3f0-4f66-b347-0b4e9f2d4e64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.550343 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c230a7bd-f3f0-4f66-b347-0b4e9f2d4e64 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.552496 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c230a7bd-f3f0-4f66-b347-0b4e9f2d4e64 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2aae8d23-92a7-4bb0-acdc-7a19b112309f HTTP/1.1" status: 204 len: 168 time: 0.1971064 Jan 05 15:02:59.565391 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c230a7bd-f3f0-4f66-b347-0b4e9f2d4e64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2aae8d23-92a7-4bb0-acdc-7a19b112309f,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:02:59.627314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b09d9851-f84a-433d-b044-dab31fbdcb88 req-adacd8b7-43b8-48b6-996c-64a0178d4112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:59.636308 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b09d9851-f84a-433d-b044-dab31fbdcb88 req-adacd8b7-43b8-48b6-996c-64a0178d4112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0727212 Jan 05 15:02:59.657219 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-9b9596ac-a048-4a8c-9d0c-a3841669b848 service neutron] 10.222.0.30 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266081 Jan 05 15:02:59.689904 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b09d9851-f84a-433d-b044-dab31fbdcb88 req-c93f1049-0d4a-4804-bd25-baf9d7618738 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524607 Jan 05 15:02:59.715071 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Router b38ee346-0c33-4eb4-8342-134f3f715196 is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114655) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 15:02:59.823985 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-54e19583-e5c1-42fa-a98c-de4843ee9f19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:02:59.825801 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-54e19583-e5c1-42fa-a98c-de4843ee9f19 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 1098 time: 0.0420144 Jan 05 15:02:59.835802 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:02:59.850005 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Sync routers for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:02:59.871107 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:02:59.873245 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:02:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:02:59.951604 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:02:59.959305 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c802b0b6-b74a-4deb-b55f-047d07cf2277 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 4.3423741 Jan 05 15:02:59.961597 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47014) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:02:59.966306 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3a4fa523-43a2-47db-a141-f5e312898197 req-5e69fb42-b6c9-4219-a49c-23c5d09c73aa tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 210 time: 0.0684569 Jan 05 15:03:00.018335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-29e36ced-e319-4e35-b24f-cb037f82c2ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:00.019858 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-29e36ced-e319-4e35-b24f-cb037f82c2ef service neutron] 10.222.0.13 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 911 time: 0.1654227 Jan 05 15:03:00.051308 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:00.111778 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-bbb3ff5e-0d84-4951-9a05-359ef8cf123e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2886de19-8aa3-470c-a593-9381bdb36ca0 HTTP/1.1" status: 200 len: 1000 time: 0.0859683 Jan 05 15:03:00.122376 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:00.170451 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-98d3cb82-39d5-41ec-94fd-84f72f7ac963 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:00.173107 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-98d3cb82-39d5-41ec-94fd-84f72f7ac963 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 200 len: 849 time: 0.0554926 Jan 05 15:03:00.229976 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-b8c428af-ef01-4faa-9a30-e89fe0cb498a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:00.232326 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-b8c428af-ef01-4faa-9a30-e89fe0cb498a service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fb7bcda7-5039-4d82-bf68-12c9acc8a744&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0526330 Jan 05 15:03:00.264244 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:00.265811 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:00.373141 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-d68420dc-3a29-439b-8c48-6b30825fa737 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1346328 Jan 05 15:03:00.429378 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2c617277-74a0-48f7-a612-ddb0399b088d req-19d26525-1e2c-48fd-96fe-052a99bd083c tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 210 time: 0.0311933 Jan 05 15:03:00.458812 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:02:58Z', 'revision_number': 3, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:02:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:00.494550 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Checking router: b38ee346-0c33-4eb4-8342-134f3f715196 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:03:00.495179 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Updating router b38ee346-0c33-4eb4-8342-134f3f715196 port f52cee16-e7b4-4acc-9ce6-5dad24163904 binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:03:00.520332 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4e889195-a597-489c-bd1d-1a0b9db11695 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:00.535799 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ddb4d2bd-2696-43e2-a176-23022d3c5496 req-f4efafe0-9ab4-4ea0-9539-d6beabe8c04d service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1495326 Jan 05 15:03:00.537923 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:00.618492 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:00.819172 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Allocated IP 172.20.0.1 (e5205e82-a517-4157-848a-78560d0d2806/c3f10689-3a61-4de7-8ebe-99aa4c5a6a83/81e8155b-5d11-486f-885b-dcbde5c4defc) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:00.843116 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:00.847344 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 req-75ed5e15-8863-4c53-ae60-28f32eb22780 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:00.849622 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 req-75ed5e15-8863-4c53-ae60-28f32eb22780 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0568357 Jan 05 15:03:00.898697 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b519c4bd-8eae-4b14-ac32-a9db571e4b38 req-fa512e4e-0177-4582-b101-93ded474e4c9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445929 Jan 05 15:03:00.929947 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:00.986723 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.049411 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Attempting to bind port f52cee16-e7b4-4acc-9ce6-5dad24163904 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:01.052105 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Attempting to bind port f52cee16-e7b4-4acc-9ce6-5dad24163904 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:01.052105 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Attempting to bind port f52cee16-e7b4-4acc-9ce6-5dad24163904 on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:01.052477 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1318a3c-da46-4002-806e-18666803dbbc None None] Pushing event updated for resources: {'Port': ['ID=f52cee16-e7b4-4acc-9ce6-5dad24163904,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:01.057985 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:01.058359 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:01.058752 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.059132 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:01.059655 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Bound port: f52cee16-e7b4-4acc-9ce6-5dad24163904, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:01.060036 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.076099 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-78355580-7ab7-40c1-9b0c-794b5823aa40 req-feea5e87-3119-4620-9233-79d306a622dc tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 210 time: 0.0431175 Jan 05 15:03:01.127173 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] For port f52cee16-e7b4-4acc-9ce6-5dad24163904, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:01.130744 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] For port f52cee16-e7b4-4acc-9ce6-5dad24163904, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f52cee16-e7b4-4acc-9ce6-5dad24163904,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:01.236116 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.275008 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Network e5205e82-a517-4157-848a-78560d0d2806 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:01.277712 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:01.284554 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:01.287496 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Pushing event updated for resources: {'Port': ['ID=81e8155b-5d11-486f-885b-dcbde5c4defc,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:01.322488 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.358950 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.446330 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:01.446976 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:01.448949 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1318a3c-da46-4002-806e-18666803dbbc None None] Pushing event updated for resources: {'Port': ['ID=f52cee16-e7b4-4acc-9ce6-5dad24163904,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:01.548417 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.567938 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e041fff9-4b9a-4500-8163-b1daca1c2c05 req-5802e617-c157-4d8d-a029-044cbb743cc5 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 210 time: 0.0284064 Jan 05 15:03:01.583743 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:01.704983 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-7cf424a8-b7b2-49d4-9738-dba018a6bbbc None None] Provisioning complete for port 81e8155b-5d11-486f-885b-dcbde5c4defc triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:01.705528 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-7cf424a8-b7b2-49d4-9738-dba018a6bbbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.726700 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.838247 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.906839 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:01.908915 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Pushing event updated for resources: {'Port': ['ID=81e8155b-5d11-486f-885b-dcbde5c4defc,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:01.911589 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-7cf424a8-b7b2-49d4-9738-dba018a6bbbc None None] Port 81e8155b-5d11-486f-885b-dcbde5c4defc cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:01.984503 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:02:58Z', 'revision_number': 3, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:02.018529 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-907457b3-974a-487e-b4c1-ebcee98695f6 None None] The sync data for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi is: [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:02:58Z', 'revision_number': 3, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:03:02.031521 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:02.042283 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-7b163f1d-ea36-43ec-b3cd-10f6cfd268c4 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=27614f6e32454ccaa602817f1658ac5a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0390580 Jan 05 15:03:02.073541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d391a9b1-d5ce-4921-837e-495d7782c0c0 req-8c1f9259-7272-441e-8d28-4d22105285c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:02.075105 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d391a9b1-d5ce-4921-837e-495d7782c0c0 req-8c1f9259-7272-441e-8d28-4d22105285c0 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0959158 Jan 05 15:03:02.080782 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Network e5205e82-a517-4157-848a-78560d0d2806 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:02.088422 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:02.256010 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d391a9b1-d5ce-4921-837e-495d7782c0c0 req-d5cf5af2-a40f-4e11-93bd-0060b4b70829 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1740141 Jan 05 15:03:02.286518 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-970c4083-ebf7-4437-a89f-36e1a5292813 req-c4055ecd-7d4c-42d1-93d2-0fcbeb5d4ad2 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 210 time: 0.0561044 Jan 05 15:03:02.303797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-9b0316df-eeb2-467e-9c0e-cff33207e935 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:02.305469 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-9b0316df-eeb2-467e-9c0e-cff33207e935 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2552490 Jan 05 15:03:02.339973 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Request body: {'port': {'device_id': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef', 'admin_state_up': True, 'tenant_id': '27614f6e32454ccaa602817f1658ac5a'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:02.354477 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Router b38ee346-0c33-4eb4-8342-134f3f715196 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:03:02.561224 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-5ebb92aa-4f33-4e88-b736-7c5e09a19d22 None None] Provisioning complete for port 81e8155b-5d11-486f-885b-dcbde5c4defc triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:02.561915 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5ebb92aa-4f33-4e88-b736-7c5e09a19d22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:02.563081 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:03:02.573113 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-18d2985b-d962-415f-985d-1684cd4577ee admin admin] 10.222.0.30 "PUT /v2.0/routers/b38ee346-0c33-4eb4-8342-134f3f715196/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6063764 Jan 05 15:03:02.626630 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-5ebb92aa-4f33-4e88-b736-7c5e09a19d22 None None] Port 81e8155b-5d11-486f-885b-dcbde5c4defc cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:02.657555 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Made reservation on behalf of 27614f6e32454ccaa602817f1658ac5a for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:03:02.662473 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:02.677398 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:02.711117 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1822d565-9b86-454d-8389-12751ce33f30 req-92ca9829-f614-4298-ba35-657825e6c0ea tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 210 time: 0.0320528 Jan 05 15:03:02.764478 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:02.798802 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:02.891916 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:02.972437 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1866185b-859f-4cdd-968a-604a5388536f,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:03.046807 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Allocated IP 192.168.233.97 (29d7c43c-ecaf-4875-bf66-b4812c9f9cef/a3c0e4e9-a75e-41b4-ad85-5081880d4366/c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:03.200998 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.335497 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-f50c7fcd-f418-4698-b3fb-52f109d65a70 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:03.337274 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-f50c7fcd-f418-4698-b3fb-52f109d65a70 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 814 time: 0.1280451 Jan 05 15:03:03.356272 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'port': {'device_id': '22497ce1-6400-4f16-a962-dce627a97693', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'admin_state_up': True, 'tenant_id': 'b874b608d2c848a88541148e56d2114d'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:03.425179 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1cbf301-b3cd-4144-8f17-b848d3c9136d req-b987f1df-6a8a-4fdc-bc33-66aeca503192 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 210 time: 0.0531132 Jan 05 15:03:03.429690 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.514309 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:03.520694 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.532796 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:03.535338 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:03.545904 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Pushing event updated for resources: {'Port': ['ID=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:03.589254 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47100) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:03.596322 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1097934503-network', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:03.604665 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:03.605599 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.781400 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-73e15341-3765-43b4-8189-b23c1c51250e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.4602625 Jan 05 15:03:03.798168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Request body: {'port': {'device_id': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:03.820233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Made reservation on behalf of b874b608d2c848a88541148e56d2114d for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:03:03.823848 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.852928 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3d4868-62e9-4f71-b127-6a701e2acd07 req-66aa9ca5-2caa-403c-a7d0-b402006d90db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:03.854951 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7f3d4868-62e9-4f71-b127-6a701e2acd07 req-66aa9ca5-2caa-403c-a7d0-b402006d90db tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 935 time: 0.0553870 Jan 05 15:03:03.859047 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-164047f9-f679-483b-8758-d03f2513b527 None None] Provisioning complete for port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:03.860009 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-164047f9-f679-483b-8758-d03f2513b527 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.889953 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Made reservation on behalf of 876c395cd3f14110b4af4a7988e9b4c1 for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:03:03.893486 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.899771 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.907714 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:03.908031 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-164047f9-f679-483b-8758-d03f2513b527 None None] Port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:03.955818 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7f3d4868-62e9-4f71-b127-6a701e2acd07 req-176fde3b-cd74-444b-a1cf-169197e7f08a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848937 Jan 05 15:03:04.023742 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Sync routers for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:03:04.041528 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:04.043172 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:04.065843 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.098489 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f52cee16-e7b4-4acc-9ce6-5dad24163904 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:04.125882 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Allocated IP 172.20.0.11 (88c2382a-d403-4004-b3bd-23c5e1ff004f/8f70bd05-fae0-4a73-a39b-d1442f8ef93c/4bda96b8-bc6e-4586-8d4d-5a66846e4b96) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:04.163610 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:04.171159 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port f52cee16-e7b4-4acc-9ce6-5dad24163904 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:04.171535 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.194629 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.210853 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 115} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:03:04.236750 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.237239 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Added segment aa897a0e-2f5f-409f-9c54-e54d16b8acdf of type vlan for network c1f8eb4e-612b-4878-8235-63de39015c64 Jan 05 15:03:04.263618 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.287402 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port f52cee16-e7b4-4acc-9ce6-5dad24163904, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f52cee16-e7b4-4acc-9ce6-5dad24163904,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:04.320275 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.349612 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d50be4ef-f542-4cc9-aee0-07cf0a4e2761,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:04.376151 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 2, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:04.403939 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Checking router: b38ee346-0c33-4eb4-8342-134f3f715196 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:03:04.404300 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Updating router b38ee346-0c33-4eb4-8342-134f3f715196 port 81e8155b-5d11-486f-885b-dcbde5c4defc binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:03:04.429217 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.449882 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.482588 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:03:04.495790 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.496933 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:04.497058 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.497888 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.535611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.570902 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Transition to ACTIVE for port object c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:03:04.572567 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=f52cee16-e7b4-4acc-9ce6-5dad24163904,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:04.579845 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.628173 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] Pushing event updated for resources: {'Network': ['ID=c1f8eb4e-612b-4878-8235-63de39015c64,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:04.641332 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network c1f8eb4e-612b-4878-8235-63de39015c64 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:03:04.651513 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c0a42f5d-6a31-4c92-8819-07ba22ad1ac9 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.0600204 Jan 05 15:03:04.662533 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47132) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:04.664826 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6e5d8b56-b211-48b5-882e-81caf9dcbcc4 req-ae986f7e-2439-4abb-b39f-b3935dd75630 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 210 time: 0.0744858 Jan 05 15:03:04.671014 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Request body: {'subnet': {'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1097934503-subnet', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'ip_version': 4}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:04.715841 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.814962 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Pushing event updated for resources: {'Port': ['ID=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:04.827797 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Made reservation on behalf of 876c395cd3f14110b4af4a7988e9b4c1 for: {'subnet': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:03:04.831386 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4267422'] for subnet, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:04.868893 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.000404 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:05.005916 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:05.009652 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:05.028083 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:05.217415 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Attempting to bind port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:05.217824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Attempting to bind port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:05.218768 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Attempting to bind port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 on network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:05.229123 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 on network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:03:05.230713 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Attempting to bind port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 on network 29d7c43c-ecaf-4875-bf66-b4812c9f9cef {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:05.243500 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.262752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:05.270757 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.277024 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:05.277738 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Checking segment: {'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:05.280662 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Bound using segment: {'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:05.281335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Bound port: c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1b024b10-d466-4bbb-8a27-b254862142ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:05.281872 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.337959 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.425988 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0acf7621-d4d9-4ba6-842c-e3b9473b001c None None] Pushing event updated for resources: {'Port': ['ID=81e8155b-5d11-486f-885b-dcbde5c4defc,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:05.444041 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-a7b1d3c1-3342-493c-ac66-3b191c74ad2c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0921199 Jan 05 15:03:05.518398 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Attempting to bind port 81e8155b-5d11-486f-885b-dcbde5c4defc on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:05.518983 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Attempting to bind port 81e8155b-5d11-486f-885b-dcbde5c4defc by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:05.519529 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Attempting to bind port 81e8155b-5d11-486f-885b-dcbde5c4defc on network e5205e82-a517-4157-848a-78560d0d2806 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:05.522433 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-959bea27-e5a1-466a-aa7e-a1b1f91362e1 None None] Provisioning complete for port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:05.523468 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-959bea27-e5a1-466a-aa7e-a1b1f91362e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.530244 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:05.531070 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Checking segment: {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:05.531626 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.532187 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Bound using segment: {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:05.532678 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Bound port: 81e8155b-5d11-486f-885b-dcbde5c4defc, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:05.535260 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.540779 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Request body: {'port': {'device_id': '22497ce1-6400-4f16-a962-dce627a97693', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:05.590983 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-959bea27-e5a1-466a-aa7e-a1b1f91362e1 None None] Port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:05.604115 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] For port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:05.650168 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] For port 81e8155b-5d11-486f-885b-dcbde5c4defc, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:05.654079 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] For port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,segment=NetworkSegment(1b024b10-d466-4bbb-8a27-b254862142ea),segment_id=1b024b10-d466-4bbb-8a27-b254862142ea)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:05.654268 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] For port 81e8155b-5d11-486f-885b-dcbde5c4defc, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=81e8155b-5d11-486f-885b-dcbde5c4defc,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:05.732486 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.748416 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.772658 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.819853 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 req-dd916c1a-5fa7-43e7-b821-7b37743928ae tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:05.822174 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 req-dd916c1a-5fa7-43e7-b821-7b37743928ae tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 947 time: 0.7303317 Jan 05 15:03:05.840157 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-3bc3a72b-4902-462f-bcfd-fa28e5862d9c None None] Provisioning complete for port 81e8155b-5d11-486f-885b-dcbde5c4defc triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:05.840602 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3bc3a72b-4902-462f-bcfd-fa28e5862d9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.881805 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0acf7621-d4d9-4ba6-842c-e3b9473b001c None None] Pushing event updated for resources: {'Port': ['ID=81e8155b-5d11-486f-885b-dcbde5c4defc,revision_number=4']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:05.909624 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:05.910260 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.911688 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] 10.222.0.13 "PUT /v2.0/ports/c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 HTTP/1.1" status: 200 len: 1097 time: 2.1179466 Jan 05 15:03:05.912160 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'tag': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:05.918289 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03015b8b-4cbb-4b61-a41f-29f012778990" -d '{"events": [{"name": "network-changed", "server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:05.918546 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d9628ae9-0eab-4d1b-b84e-2c4c798d92b1 req-98a045bb-a2cf-408a-9e2c-7da8d21ffe01 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0857716 Jan 05 15:03:05.946348 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4701419', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4267372'] for subnet, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:05.963302 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:05.964318 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:06.003240 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56841fcb-0128-4eb3-ba24-47583b974257 service neutron] Pushing event updated for resources: {'Port': ['ID=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:06.092148 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Pushing event updated for resources: {'Subnet': ['ID=911a986a-d792-4f9a-89d1-a506c7e3b90e,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:06.179767 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Checking segment: {'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:06.181666 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3bc3a72b-4902-462f-bcfd-fa28e5862d9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.185559 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Network hostable DHCP agents. Network: c1f8eb4e-612b-4878-8235-63de39015c64, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114655) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:03:06.190775 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f52cee16-e7b4-4acc-9ce6-5dad24163904 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:06.245202 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-632ca233-e109-4c8f-8cb8-f9bd112ee50a x-openstack-request-id: req-632ca233-e109-4c8f-8cb8-f9bd112ee50a {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:06.245573 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:06.245847 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-632ca233-e109-4c8f-8cb8-f9bd112ee50a {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:06.246259 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'tag': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8', 'status': 'completed', 'code': 200} Jan 05 15:03:06.303939 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 req-0e65840c-a2d1-4f8a-95c1-bc0ab6288897 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:06.311163 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 req-0e65840c-a2d1-4f8a-95c1-bc0ab6288897 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 932 time: 0.4688764 Jan 05 15:03:06.326281 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Network c1f8eb4e-612b-4878-8235-63de39015c64 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114655) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:03:06.326509 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port f52cee16-e7b4-4acc-9ce6-5dad24163904 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:06.326783 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.332212 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-3bc3a72b-4902-462f-bcfd-fa28e5862d9c None None] For port 81e8155b-5d11-486f-885b-dcbde5c4defc, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=81e8155b-5d11-486f-885b-dcbde5c4defc,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:06.353724 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:06.455285 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3bc3a72b-4902-462f-bcfd-fa28e5862d9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.461090 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, c1f8eb4e-612b-4878-8235-63de39015c64) {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:06.465845 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:06.466711 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.472400 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a2228c44-3a9d-42a8-9af0-7c1cd4825621 req-8e56e147-8164-4981-9376-304a72b4d570 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1550221 Jan 05 15:03:06.476433 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-bd0ffe45-53a9-4f1e-baec-56fd20ee3e4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:06.479794 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-bd0ffe45-53a9-4f1e-baec-56fd20ee3e4d service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=27614f6e32454ccaa602817f1658ac5a&device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 1100 time: 0.2634282 Jan 05 15:03:06.479934 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c1b4f4c-4e62-4bb7-91f3-3d97b6bdc840 None None] Network c1f8eb4e-612b-4878-8235-63de39015c64 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:03:06.566512 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-a1a582e8-d2f2-4209-964d-71826d0461de service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.97&port_id=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 HTTP/1.1" status: 200 len: 217 time: 0.0487168 Jan 05 15:03:06.614616 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f40c3379-1e63-4c62-a96c-69fef0609c4c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.9495471 Jan 05 15:03:06.615533 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bc3a72b-4902-462f-bcfd-fa28e5862d9c None None] Pushing event updated for resources: {'Port': ['ID=81e8155b-5d11-486f-885b-dcbde5c4defc,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:06.616640 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47146) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:06.635052 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:06.653146 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:03:06.664106 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.681927 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Transition to ACTIVE for port object 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:03:06.708161 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-65f064d7-f077-4c1f-bc11-ac21103bcd99 None None] Provisioning complete for port 81e8155b-5d11-486f-885b-dcbde5c4defc triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:06.708729 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-65f064d7-f077-4c1f-bc11-ac21103bcd99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.711968 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c1f8eb4e-612b-4878-8235-63de39015c64', 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64', 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'fixed_ips': [{'subnet_id': '911a986a-d792-4f9a-89d1-a506c7e3b90e'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 15:03:06.713349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.760637 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.762879 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.803301 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.867717 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:06.914405 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:05Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:06.927292 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Pushing event updated for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:06.978701 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Allocated IP 172.20.0.2 (c1f8eb4e-612b-4878-8235-63de39015c64/911a986a-d792-4f9a-89d1-a506c7e3b90e/11b871bd-555d-4adf-beee-7afb2e1e5b73) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:07.021585 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdee3ed9-2652-436d-9298-90547e10cb98 None None] The sync data for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi is: [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:05Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:03:07.344895 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Attempting to bind port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:07.345400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Attempting to bind port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:07.345766 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Attempting to bind port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 on network 88c2382a-d403-4004-b3bd-23c5e1ff004f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:07.367373 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-ec14ae19-50ab-47b7-93c1-899e6178ca52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:07.369096 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-ec14ae19-50ab-47b7-93c1-899e6178ca52 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a3c0e4e9-a75e-41b4-ad85-5081880d4366 HTTP/1.1" status: 200 len: 843 time: 0.3763192 Jan 05 15:03:07.383143 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:07.391883 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 on network 88c2382a-d403-4004-b3bd-23c5e1ff004f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:03:07.392458 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Attempting to bind port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 on network 88c2382a-d403-4004-b3bd-23c5e1ff004f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:07.445220 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de0658cf-a5d9-403e-b385-76c1a832df0a req-6c4e0c0d-1d50-44ac-8f5f-0fd5187f9816 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:07.447033 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-de0658cf-a5d9-403e-b385-76c1a832df0a req-6c4e0c0d-1d50-44ac-8f5f-0fd5187f9816 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 947 time: 0.3574178 Jan 05 15:03:07.462859 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:07.464183 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Checking segment: {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:07.464394 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:07.465373 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Bound using segment: {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:07.466418 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Bound port: 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4f800182-f71d-4001-8825-29298b38881e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:07.467185 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:07.504833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-a7d46a77-ce4b-43cd-92e8-406b8e3271e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:07.517437 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-a7d46a77-ce4b-43cd-92e8-406b8e3271e8 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=29d7c43c-ecaf-4875-bf66-b4812c9f9cef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1168494 Jan 05 15:03:07.592139 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:07.632729 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-de0658cf-a5d9-403e-b385-76c1a832df0a req-0d2132e4-ccb2-4ca8-bf5e-d68608f4e724 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1735363 Jan 05 15:03:07.708629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:07.716515 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Network c1f8eb4e-612b-4878-8235-63de39015c64 is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:07.722221 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:07.735384 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:07.761569 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:07.774925 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eae43aa-7902-4798-97d7-35f6db48f679 req-c3963c54-0bde-41a0-9701-8028efe11feb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:07.783472 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4eae43aa-7902-4798-97d7-35f6db48f679 req-c3963c54-0bde-41a0-9701-8028efe11feb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.1396968 Jan 05 15:03:07.804833 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-2cbcce19-7c57-4577-bb74-ecab8211fa32 service neutron] 10.222.0.13 "GET /v2.0/networks/29d7c43c-ecaf-4875-bf66-b4812c9f9cef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2607579 Jan 05 15:03:07.805470 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Pushing event updated for resources: {'Port': ['ID=11b871bd-555d-4adf-beee-7afb2e1e5b73,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:07.865090 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Attempting to bind port 11b871bd-555d-4adf-beee-7afb2e1e5b73 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:07.865516 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Attempting to bind port 11b871bd-555d-4adf-beee-7afb2e1e5b73 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:07.865861 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Attempting to bind port 11b871bd-555d-4adf-beee-7afb2e1e5b73 on network c1f8eb4e-612b-4878-8235-63de39015c64 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:07.876074 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:07.876447 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Checking segment: {'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:07.876847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:07.877275 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Bound using segment: {'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:07.877750 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Bound port: 11b871bd-555d-4adf-beee-7afb2e1e5b73, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:07.885279 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:07.893001 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:07.909155 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4eae43aa-7902-4798-97d7-35f6db48f679 req-34e4d401-5b83-434f-a146-6ae73755d323 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1235559 Jan 05 15:03:08.030131 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] For port 11b871bd-555d-4adf-beee-7afb2e1e5b73, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:08.038512 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] For port 11b871bd-555d-4adf-beee-7afb2e1e5b73, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=11b871bd-555d-4adf-beee-7afb2e1e5b73,segment=NetworkSegment(aa897a0e-2f5f-409f-9c54-e54d16b8acdf),segment_id=aa897a0e-2f5f-409f-9c54-e54d16b8acdf)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:08.059424 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:08.103448 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:08.103448 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:08.105260 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] 10.222.0.13 "PUT /v2.0/ports/4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 1094 time: 2.5819347 Jan 05 15:03:08.107393 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3a6fa07-966f-4368-9ebd-c76ff441eada req-f3d7053b-1c53-422f-81f1-9c8c11c4b28f service neutron] 10.222.0.13 "GET /v2.0/networks/29d7c43c-ecaf-4875-bf66-b4812c9f9cef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2903328 Jan 05 15:03:08.107948 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 81e8155b-5d11-486f-885b-dcbde5c4defc up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:08.108109 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bdb000-7c66-40f1-9589-037dd116f891 service neutron] Pushing event updated for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:08.110290 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:08.206900 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:08.249947 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:08.252247 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-19e1d0c8-8100-48d0-aa90-d4f2671cc819" -d '{"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:08.277007 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 81e8155b-5d11-486f-885b-dcbde5c4defc triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:08.277413 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:08.286645 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Allocated IP 172.37.2.87 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/4ef02e08-ded0-413d-930b-b2d30049efc6) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:08.391704 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e28e2537-ceda-4eae-b78e-93a95f488a5a x-openstack-request-id: req-e28e2537-ceda-4eae-b78e-93a95f488a5a {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:08.392629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:08.392629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e28e2537-ceda-4eae-b78e-93a95f488a5a {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:08.416162 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'status': 'completed', 'code': 200} Jan 05 15:03:08.420106 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d74b77f-a2ad-4807-aa78-216ec35a0ed2 None None] Pushing event updated for resources: {'Port': ['ID=11b871bd-555d-4adf-beee-7afb2e1e5b73,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:08.466471 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-7b1ef8b1-13a9-42f8-8536-9079bcd6285c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:08.474007 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-7b1ef8b1-13a9-42f8-8536-9079bcd6285c service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1097 time: 0.1334398 Jan 05 15:03:08.563104 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:08.666158 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:08.751348 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:08.755046 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:08.757776 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:08.942770 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-ab1e3a76-47ab-40e9-96fe-b00ce44a905f service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 217 time: 0.1642790 Jan 05 15:03:08.966699 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:03:09.098377 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80079fdd-3047-439f-a9dc-0c132c3753a7 req-8005a5e8-81b9-454a-9751-2c8616de8afe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:09.106934 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80079fdd-3047-439f-a9dc-0c132c3753a7 req-8005a5e8-81b9-454a-9751-2c8616de8afe tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 947 time: 0.3533635 Jan 05 15:03:09.135822 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-f653432b-f903-423b-9738-30041bcd953a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:09.137569 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-f653432b-f903-423b-9738-30041bcd953a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.1849763 Jan 05 15:03:09.141199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-88d07739-a2eb-4431-96da-c4aa106171d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:09.142803 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-88d07739-a2eb-4431-96da-c4aa106171d3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=27614f6e32454ccaa602817f1658ac5a&device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 1100 time: 0.3632085 Jan 05 15:03:09.209818 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Pushing event updated for resources: {'Port': ['ID=4ef02e08-ded0-413d-930b-b2d30049efc6,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:09.236227 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 req-a47194d7-3452-4e59-9367-d5576962e033 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:09.238366 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80079fdd-3047-439f-a9dc-0c132c3753a7 req-644e8e4f-611c-4871-9a3a-50343f3ffbd4 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299005 Jan 05 15:03:09.248494 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 req-a47194d7-3452-4e59-9367-d5576962e033 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.1898038 Jan 05 15:03:09.325836 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-906d773d-b47b-413f-acd6-60e8d73a19de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:09.325836 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-906d773d-b47b-413f-acd6-60e8d73a19de service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1442327 Jan 05 15:03:09.379269 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-4251b6ce-1033-46ed-b767-6bc40c808561 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:09.380960 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-4251b6ce-1033-46ed-b767-6bc40c808561 service neutron] 10.222.0.13 "GET /v2.0/networks?id=29d7c43c-ecaf-4875-bf66-b4812c9f9cef HTTP/1.1" status: 200 len: 870 time: 0.2082131 Jan 05 15:03:09.465595 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:09.538422 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-aa4ee87d-8cf5-4b71-9253-05fe847c5e64 req-e0997a89-229d-47ef-947e-7e96441bbe60 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2886891 Jan 05 15:03:09.828135 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:09.974952 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-e3aee12e-eade-41f4-97f5-34cfa0941714 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.97&port_id=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 HTTP/1.1" status: 200 len: 217 time: 0.4192119 Jan 05 15:03:10.080350 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-b7625c80-60c5-47f0-a262-161f0635ecfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:10.081993 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-b7625c80-60c5-47f0-a262-161f0635ecfa service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a3c0e4e9-a75e-41b4-ad85-5081880d4366 HTTP/1.1" status: 200 len: 843 time: 0.0769377 Jan 05 15:03:10.117449 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-d5065001-d6ab-4da2-8df0-aaff897e4772 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5692279 Jan 05 15:03:10.143907 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 11b871bd-555d-4adf-beee-7afb2e1e5b73 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:10.169288 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Router a3300cf8-c042-4d6e-a24f-3260216ca937 is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114655) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 15:03:10.181768 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-9cbcd9ed-5768-478d-b34a-8acd222d0998 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:10.187192 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-9cbcd9ed-5768-478d-b34a-8acd222d0998 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=29d7c43c-ecaf-4875-bf66-b4812c9f9cef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0968990 Jan 05 15:03:10.207418 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 11b871bd-555d-4adf-beee-7afb2e1e5b73 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:10.207858 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:10.339807 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a60d3db-2bd8-435f-86a0-8f46e7c0ec6b None None] Network c1f8eb4e-612b-4878-8235-63de39015c64 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:03:10.407367 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-4fce5568-3844-4ea9-b44c-27d84d5e10ba service neutron] 10.222.0.13 "GET /v2.0/networks/29d7c43c-ecaf-4875-bf66-b4812c9f9cef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1770627 Jan 05 15:03:10.441302 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f956c8-3c54-4eba-a5c2-376d5790e320 req-99746d73-0b56-4f87-81f4-2c358913f17c service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2993460 Jan 05 15:03:10.464689 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:03:10.484177 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Sync routers for ids ['a3300cf8-c042-4d6e-a24f-3260216ca937'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:03:10.506346 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21424513-0484-4dfb-a4e4-9ce401572cb6 req-104f4ad8-d329-44f0-b167-bb711a0b78cc tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:10.508269 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-21424513-0484-4dfb-a4e4-9ce401572cb6 req-104f4ad8-d329-44f0-b167-bb711a0b78cc tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 947 time: 0.0698853 Jan 05 15:03:10.523237 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:10.525545 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-5229de4c-7f3b-4df2-85ae-41a6a75fa4f1 None None] Provisioning complete for port 11b871bd-555d-4adf-beee-7afb2e1e5b73 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:10.526102 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5229de4c-7f3b-4df2-85ae-41a6a75fa4f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:10.574223 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Routers {'a3300cf8-c042-4d6e-a24f-3260216ca937'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:10.575123 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['a3300cf8-c042-4d6e-a24f-3260216ca937'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:10.594935 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:10.596449 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1d67c9d9-b1dc-4471-9c36-3a65b6489887 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 3.9780083 Jan 05 15:03:10.598856 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47196) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:10.611733 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-21424513-0484-4dfb-a4e4-9ce401572cb6 req-d52d7871-79b0-40aa-9107-fba38132fcfd tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966139 Jan 05 15:03:10.689023 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 11b871bd-555d-4adf-beee-7afb2e1e5b73, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=11b871bd-555d-4adf-beee-7afb2e1e5b73,segment=NetworkSegment(aa897a0e-2f5f-409f-9c54-e54d16b8acdf),segment_id=aa897a0e-2f5f-409f-9c54-e54d16b8acdf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:10.794975 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-03015b8b-4cbb-4b61-a41f-29f012778990 req-c649eb3e-e3bd-4518-af64-4480a90f2764 service neutron] 10.222.0.13 "GET /v2.0/networks/29d7c43c-ecaf-4875-bf66-b4812c9f9cef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1239688 Jan 05 15:03:10.866178 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:10.921156 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a req-74ebcd85-e6d3-4870-9284-624b014b0a40 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:10.931770 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Set router a3300cf8-c042-4d6e-a24f-3260216ca937 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:10.933757 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a req-74ebcd85-e6d3-4870-9284-624b014b0a40 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.2451928 Jan 05 15:03:11.019452 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-395bbadd-b22b-47f8-87b5-8df9f50ed6e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:11.021279 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-395bbadd-b22b-47f8-87b5-8df9f50ed6e8 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1097 time: 0.0646093 Jan 05 15:03:11.048924 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=11b871bd-555d-4adf-beee-7afb2e1e5b73,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:11.205175 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5dc5f4ac-53ea-4af4-a3fe-b9845dfac79a req-7f2c1a67-f770-428b-81af-13923325928b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2556841 Jan 05 15:03:11.268739 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87'}], 'enable_snat': True}, 'gw_port_id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:03:09Z', 'revision_number': 3, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port': {'id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:fc:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_gateway', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:08Z', 'updated_at': '2022-01-05T15:03:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:11.271843 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-a42daa7e-d187-4cf8-941a-46834a525a22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:11.277016 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-a42daa7e-d187-4cf8-941a-46834a525a22 service neutron] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 915 time: 0.2480927 Jan 05 15:03:11.301963 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Checking router: a3300cf8-c042-4d6e-a24f-3260216ca937 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:03:11.302921 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Updating router a3300cf8-c042-4d6e-a24f-3260216ca937 port 4ef02e08-ded0-413d-930b-b2d30049efc6 binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:03:11.334384 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.392597 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-29869ca5-de36-449c-8547-e18354d8495c None None] Provisioning complete for port 11b871bd-555d-4adf-beee-7afb2e1e5b73 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:11.393075 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-29869ca5-de36-449c-8547-e18354d8495c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.511745 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.761370 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.762069 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe req-eb678079-2569-4e3b-82e3-297e4937c246 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:11.769892 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe req-eb678079-2569-4e3b-82e3-297e4937c246 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 947 time: 0.0616367 Jan 05 15:03:11.797516 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Allocated IP 172.20.0.1 (c1f8eb4e-612b-4878-8235-63de39015c64/911a986a-d792-4f9a-89d1-a506c7e3b90e/aff7dea8-8427-4fbd-a092-874fdaa8aad8) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:11.828497 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-56b500a3-056f-4551-9ffb-1c8b1e4c7bfe req-f57efc36-cf99-426a-9131-d0721e64b69f tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576584 Jan 05 15:03:11.838488 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.896821 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d96d5d8c-1083-45a4-9d26-5bf75930b586 None None] Pushing event updated for resources: {'Port': ['ID=4ef02e08-ded0-413d-930b-b2d30049efc6,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:11.900246 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Attempting to bind port 4ef02e08-ded0-413d-930b-b2d30049efc6 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:11.900692 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Attempting to bind port 4ef02e08-ded0-413d-930b-b2d30049efc6 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:11.901150 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Attempting to bind port 4ef02e08-ded0-413d-930b-b2d30049efc6 on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:11.910615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:11.910615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:11.910615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.910615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:11.910615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Bound port: 4ef02e08-ded0-413d-930b-b2d30049efc6, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:11.910615 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.970810 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:11.979954 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] For port 4ef02e08-ded0-413d-930b-b2d30049efc6, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:11.985362 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] For port 4ef02e08-ded0-413d-930b-b2d30049efc6, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ef02e08-ded0-413d-930b-b2d30049efc6,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:12.054410 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 11b871bd-555d-4adf-beee-7afb2e1e5b73 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:12.119615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:12.138596 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:12.149200 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Network c1f8eb4e-612b-4878-8235-63de39015c64 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:12.179186 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:12.184187 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:12.226881 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Routers {'a3300cf8-c042-4d6e-a24f-3260216ca937'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:12.227671 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['a3300cf8-c042-4d6e-a24f-3260216ca937'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:12.234699 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d96d5d8c-1083-45a4-9d26-5bf75930b586 None None] Pushing event updated for resources: {'Port': ['ID=4ef02e08-ded0-413d-930b-b2d30049efc6,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:12.301183 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 11b871bd-555d-4adf-beee-7afb2e1e5b73 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:12.301943 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:12.466273 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] Set router a3300cf8-c042-4d6e-a24f-3260216ca937 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:12.628625 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Pushing event updated for resources: {'Port': ['ID=aff7dea8-8427-4fbd-a092-874fdaa8aad8,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:12.633406 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:12.692063 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:03:12.692321 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9157785-5a3e-47c6-a741-5706bfb4aefe req-d980f03c-c09d-4b27-9152-0622d5facf57 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:12.692321 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a9157785-5a3e-47c6-a741-5706bfb4aefe req-d980f03c-c09d-4b27-9152-0622d5facf57 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.1184411 Jan 05 15:03:12.749716 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-9130bbb7-29b5-442d-92d0-c89ff4c661f2 None None] Provisioning complete for port aff7dea8-8427-4fbd-a092-874fdaa8aad8 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:12.750223 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-9130bbb7-29b5-442d-92d0-c89ff4c661f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:12.782240 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a9157785-5a3e-47c6-a741-5706bfb4aefe req-ca2059a3-6ec1-46b4-9e5d-224d1a6ae4b3 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0845606 Jan 05 15:03:12.888161 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-9130bbb7-29b5-442d-92d0-c89ff4c661f2 None None] Port aff7dea8-8427-4fbd-a092-874fdaa8aad8 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:12.899452 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:12.940303 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,segment=NetworkSegment(1b024b10-d466-4bbb-8a27-b254862142ea),segment_id=1b024b10-d466-4bbb-8a27-b254862142ea)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:12.955830 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8', 'network_id': '29d7c43c-ecaf-4875-bf66-b4812c9f9cef', 'port_id': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8', 'mac_address': 'fa:16:3e:df:90:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3c0e4e9-a75e-41b4-ad85-5081880d4366', 'ip_address': '192.168.233.97'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:03:12.986554 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b78f593-52e5-4986-847f-aeac2d13336f req-97103ca7-10e8-4591-a16a-123ee889fcf2 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:12.994661 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6b78f593-52e5-4986-847f-aeac2d13336f req-97103ca7-10e8-4591-a16a-123ee889fcf2 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 947 time: 0.0708385 Jan 05 15:03:13.002979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87'}], 'enable_snat': True}, 'gw_port_id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:03:09Z', 'revision_number': 3, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port': {'id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:fc:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_gateway', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:08Z', 'updated_at': '2022-01-05T15:03:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:13.046057 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa54decf-f0c1-497d-8c73-337312b63d6d None None] The sync data for ids ['a3300cf8-c042-4d6e-a24f-3260216ca937'] in dv-cinder-master-3-iscsi is: [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87'}], 'enable_snat': True}, 'gw_port_id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:03:09Z', 'revision_number': 3, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port': {'id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:fc:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_gateway', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:08Z', 'updated_at': '2022-01-05T15:03:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:03:13.067604 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:13.086900 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6b78f593-52e5-4986-847f-aeac2d13336f req-2672abc7-1873-493b-b074-6a4a92bd3924 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0906582 Jan 05 15:03:13.116529 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:03:13.150089 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,segment=NetworkSegment(1b024b10-d466-4bbb-8a27-b254862142ea),segment_id=1b024b10-d466-4bbb-8a27-b254862142ea)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:13.194665 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:13.250046 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:13.292313 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:13.328529 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:13.420781 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:13.540867 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Pushing event updated for resources: {'Port': ['ID=aff7dea8-8427-4fbd-a092-874fdaa8aad8,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:13.618554 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:03:13.640966 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Network c1f8eb4e-612b-4878-8235-63de39015c64 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:13.642475 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:13.814987 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Router a3300cf8-c042-4d6e-a24f-3260216ca937 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:03:14.083432 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:03:14.098450 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-05bc0e62-ae39-4d17-a515-0d4810138e40 admin admin] 10.222.0.30 "PUT /v2.0/routers/a3300cf8-c042-4d6e-a24f-3260216ca937/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4967041 Jan 05 15:03:14.141918 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 req-94648af4-ed2e-4a25-ae3e-65df71d21247 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:14.143658 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 req-94648af4-ed2e-4a25-ae3e-65df71d21247 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.1822772 Jan 05 15:03:14.230584 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ef02e08-ded0-413d-930b-b2d30049efc6 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:14.244459 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 req-257839e0-bd77-4660-b081-7f386ead94b9 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:14.257281 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 req-257839e0-bd77-4660-b081-7f386ead94b9 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 948 time: 0.0841954 Jan 05 15:03:14.266424 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1cffb7c0-faea-4ae5-9c3f-3959d0de4b52 req-9ff2232b-ed57-4fc1-ac1c-b1ffbefddb9c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1130645 Jan 05 15:03:14.342720 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-51083a3d-06b8-4343-99fe-7b11a287e4cc None None] Provisioning complete for port aff7dea8-8427-4fbd-a092-874fdaa8aad8 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:14.344074 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-51083a3d-06b8-4343-99fe-7b11a287e4cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:14.355321 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8b73b0c9-0bb1-436a-a96e-cdd4eeae3c09 req-d2745f2a-c855-42af-b1cf-1f22c1324f3e tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877807 Jan 05 15:03:14.408083 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-51083a3d-06b8-4343-99fe-7b11a287e4cc None None] Port aff7dea8-8427-4fbd-a092-874fdaa8aad8 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:14.419330 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4ef02e08-ded0-413d-930b-b2d30049efc6 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:14.419820 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:14.588225 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:14.615587 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 4ef02e08-ded0-413d-930b-b2d30049efc6, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ef02e08-ded0-413d-930b-b2d30049efc6,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:14.784718 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-0c4a5b1f-db9d-45d8-9b0b-c2e9454c4cca service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 217 time: 0.0378926 Jan 05 15:03:14.831934 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-497e6776-809f-4e8a-af00-4d6ee6d606ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:14.833384 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-497e6776-809f-4e8a-af00-4d6ee6d606ee service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.0417609 Jan 05 15:03:14.877135 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-9410dd9a-30b0-402a-955f-582ab3b48dc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:14.878604 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-9410dd9a-30b0-402a-955f-582ab3b48dc6 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0387013 Jan 05 15:03:14.976429 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-d9583536-47f9-43f6-9f87-d90eae5c4b74 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915184 Jan 05 15:03:15.046976 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:15.160184 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=4ef02e08-ded0-413d-930b-b2d30049efc6,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:15.173137 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-19e1d0c8-8100-48d0-aa90-d4f2671cc819 req-1e50bf30-f848-4ce0-9a50-c9366ddef3d6 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1434815 Jan 05 15:03:15.196169 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47248) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:15.201872 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-d8b9af76-cd6c-4d36-bfca-e9f2a85d2da4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1412084070', 'description': 'tempest-secgroup-smoke-1412084070 description', 'project_id': 'c3797435200949c8a45be6c5b0525dc0'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:15.312798 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d8b9af76-cd6c-4d36-bfca-e9f2a85d2da4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:15.400793 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d8b9af76-cd6c-4d36-bfca-e9f2a85d2da4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:15.453402 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2292c7-c67d-4dcb-b479-212506b0c63b req-94b4dcd8-9183-48e5-947b-0a4ec537d32b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:15.460831 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa2292c7-c67d-4dcb-b479-212506b0c63b req-94b4dcd8-9183-48e5-947b-0a4ec537d32b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.1089659 Jan 05 15:03:15.486133 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Sync routers for ids ['a3300cf8-c042-4d6e-a24f-3260216ca937'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:03:15.525291 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Routers {'a3300cf8-c042-4d6e-a24f-3260216ca937'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:15.526118 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['a3300cf8-c042-4d6e-a24f-3260216ca937'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:15.535141 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d8b9af76-cd6c-4d36-bfca-e9f2a85d2da4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:15.592245 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b9af76-cd6c-4d36-bfca-e9f2a85d2da4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'SecurityGroup': ['ID=773a9e22-40c2-499c-8bf9-0e8887977b03,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:15.606976 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 req-eebf3e9e-6532-4f46-b7f3-a709df286bb9 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:15.609956 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 req-eebf3e9e-6532-4f46-b7f3-a709df286bb9 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 948 time: 0.1455100 Jan 05 15:03:15.622941 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fa2292c7-c67d-4dcb-b479-212506b0c63b req-361850ba-bec9-48d5-aee9-eac72c24eb8d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1490791 Jan 05 15:03:15.680356 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d8b9af76-cd6c-4d36-bfca-e9f2a85d2da4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:15.695832 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47260) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:15.697097 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d8b9af76-cd6c-4d36-bfca-e9f2a85d2da4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4996424 Jan 05 15:03:15.700540 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-f0e9895a-9ffc-4d0b-83a2-8297e45891fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'security_group_rule': {'security_group_id': '773a9e22-40c2-499c-8bf9-0e8887977b03', 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:15.715865 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Set router a3300cf8-c042-4d6e-a24f-3260216ca937 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:15.731393 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ff68e8cb-3b91-4217-9fe7-49181a8fe325 req-c4104556-412f-4edd-bddb-c91290de84c6 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1120520 Jan 05 15:03:15.827666 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f0e9895a-9ffc-4d0b-83a2-8297e45891fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:15.885107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f0e9895a-9ffc-4d0b-83a2-8297e45891fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:15.965745 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87'}], 'enable_snat': True}, 'gw_port_id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:03:12Z', 'revision_number': 4, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port': {'id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:fc:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_gateway', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:08Z', 'updated_at': '2022-01-05T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'aff7dea8-8427-4fbd-a092-874fdaa8aad8', 'name': '', 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'mac_address': 'fa:16:3e:52:30:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_interface', 'standard_attr_id': 418, 'fixed_ips': [{'subnet_id': '911a986a-d792-4f9a-89d1-a506c7e3b90e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:11Z', 'updated_at': '2022-01-05T15:03:12Z', 'revision_number': 2, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'subnets': [{'id': '911a986a-d792-4f9a-89d1-a506c7e3b90e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:15.994586 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Checking router: a3300cf8-c042-4d6e-a24f-3260216ca937 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:03:15.994939 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Updating router a3300cf8-c042-4d6e-a24f-3260216ca937 port aff7dea8-8427-4fbd-a092-874fdaa8aad8 binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:03:16.000661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f0e9895a-9ffc-4d0b-83a2-8297e45891fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.020423 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.020587 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e9895a-9ffc-4d0b-83a2-8297e45891fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=210aba9d-2e4d-4beb-82d5-22cd2a344c18,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:16.026466 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ef02e08-ded0-413d-930b-b2d30049efc6 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:16.075449 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 4ef02e08-ded0-413d-930b-b2d30049efc6 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:16.075820 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.174600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f0e9895a-9ffc-4d0b-83a2-8297e45891fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.179304 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f0e9895a-9ffc-4d0b-83a2-8297e45891fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4791691 Jan 05 15:03:16.179518 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47262) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:16.183695 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-b898b241-5991-458b-b54d-22ae03a3c05b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'security_group_rule': {'security_group_id': '773a9e22-40c2-499c-8bf9-0e8887977b03', 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:16.293708 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.296685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b898b241-5991-458b-b54d-22ae03a3c05b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.360150 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b898b241-5991-458b-b54d-22ae03a3c05b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.371935 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.426678 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Pushing event updated for resources: {'Port': ['ID=aff7dea8-8427-4fbd-a092-874fdaa8aad8,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:16.436247 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.436636 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.437004 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.437891 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.437891 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.438049 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.438316 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.438811 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.439300 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.439806 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.440320 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.440641 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.441125 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:16.480782 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b898b241-5991-458b-b54d-22ae03a3c05b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.500173 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Attempting to bind port aff7dea8-8427-4fbd-a092-874fdaa8aad8 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:16.500648 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Attempting to bind port aff7dea8-8427-4fbd-a092-874fdaa8aad8 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:16.501212 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Attempting to bind port aff7dea8-8427-4fbd-a092-874fdaa8aad8 on network c1f8eb4e-612b-4878-8235-63de39015c64 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:16.505810 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b898b241-5991-458b-b54d-22ae03a3c05b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b4187056-5b10-4f46-b4ad-9e92eaa92aa8,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:16.512477 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:16.512477 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Checking segment: {'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:16.513378 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.513378 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Bound using segment: {'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:16.514030 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Bound port: aff7dea8-8427-4fbd-a092-874fdaa8aad8, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:16.515184 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.546897 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:16.562785 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b898b241-5991-458b-b54d-22ae03a3c05b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.566672 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b898b241-5991-458b-b54d-22ae03a3c05b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3837216 Jan 05 15:03:16.567414 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47272) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:16.571673 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-c622806c-3e7c-4529-8697-f5ece9167781 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'security_group_rule': {'security_group_id': '773a9e22-40c2-499c-8bf9-0e8887977b03', 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:16.602423 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] For port aff7dea8-8427-4fbd-a092-874fdaa8aad8, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:16.606205 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] For port aff7dea8-8427-4fbd-a092-874fdaa8aad8, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=aff7dea8-8427-4fbd-a092-874fdaa8aad8,segment=NetworkSegment(aa897a0e-2f5f-409f-9c54-e54d16b8acdf),segment_id=aa897a0e-2f5f-409f-9c54-e54d16b8acdf)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:16.648604 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-8304db95-987b-440e-b34f-4da0a59f0e88 None None] Provisioning complete for port aff7dea8-8427-4fbd-a092-874fdaa8aad8 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:16.649046 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-8304db95-987b-440e-b34f-4da0a59f0e88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.679252 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c622806c-3e7c-4529-8697-f5ece9167781 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.694561 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-8304db95-987b-440e-b34f-4da0a59f0e88 None None] Port aff7dea8-8427-4fbd-a092-874fdaa8aad8 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:16.697313 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:03:16.698748 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.701449 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:16.701816 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.744834 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Routers {'a3300cf8-c042-4d6e-a24f-3260216ca937'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:16.745594 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['a3300cf8-c042-4d6e-a24f-3260216ca937'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:16.762833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 req-e31544a1-33aa-4eec-b694-7d0ca73fb9fe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:16.764291 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 req-e31544a1-33aa-4eec-b694-7d0ca73fb9fe tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.0760639 Jan 05 15:03:16.785900 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c622806c-3e7c-4529-8697-f5ece9167781 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.815789 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.846063 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:16.849554 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6360c05d-2d19-45df-a900-4e84f790b79a" -d '{"events": [{"server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "name": "network-vif-plugged", "status": "completed", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:16.851455 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-030ee7b0-dbbd-40a0-bb08-20eb0356e0f8 req-6acbb16f-ad9b-4f72-b7b5-4dd3fbd1ff22 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720110 Jan 05 15:03:16.856327 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c622806c-3e7c-4529-8697-f5ece9167781 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:16.866238 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,segment=NetworkSegment(1b024b10-d466-4bbb-8a27-b254862142ea),segment_id=1b024b10-d466-4bbb-8a27-b254862142ea)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:16.899962 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c622806c-3e7c-4529-8697-f5ece9167781 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=39bfb817-9eeb-4ce8-bb34-486f2bf01222,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:16.931101 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 x-openstack-request-id: req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:16.931433 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "name": "network-vif-plugged", "status": "completed", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:16.931690 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-12781dcd-4bd5-41bb-a0d3-b5be13d81677 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:16.932085 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8', 'code': 200} Jan 05 15:03:16.950059 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896480d7-defb-4685-9e42-b7019cdef7db req-963a0e63-0bdc-45f6-8834-7cd5e867e565 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:16.951705 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-896480d7-defb-4685-9e42-b7019cdef7db req-963a0e63-0bdc-45f6-8834-7cd5e867e565 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 948 time: 0.0753279 Jan 05 15:03:16.964282 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.012375 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-896480d7-defb-4685-9e42-b7019cdef7db req-1ea0c1ca-fe60-4864-bf58-d68819120d02 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542452 Jan 05 15:03:17.028425 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d584ff1a-5e92-4895-90a6-d29e4dca702b None None] Pushing event updated for resources: {'Port': ['ID=aff7dea8-8427-4fbd-a092-874fdaa8aad8,revision_number=4']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:17.036371 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] Set router a3300cf8-c042-4d6e-a24f-3260216ca937 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:17.063306 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c622806c-3e7c-4529-8697-f5ece9167781 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.063415 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-59f1e9fa-ecdf-4476-939c-08d087e6fe55 None None] Provisioning complete for port aff7dea8-8427-4fbd-a092-874fdaa8aad8 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:17.063415 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-59f1e9fa-ecdf-4476-939c-08d087e6fe55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.063915 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c622806c-3e7c-4529-8697-f5ece9167781 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4834352 Jan 05 15:03:17.065326 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47280) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:17.070490 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-61218949-bed7-4f96-9507-33e339d38ba1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'security_group_rule': {'security_group_id': '773a9e22-40c2-499c-8bf9-0e8887977b03', 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:17.072592 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:17.133894 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-59f1e9fa-ecdf-4476-939c-08d087e6fe55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.166045 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-59f1e9fa-ecdf-4476-939c-08d087e6fe55 None None] For port aff7dea8-8427-4fbd-a092-874fdaa8aad8, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=aff7dea8-8427-4fbd-a092-874fdaa8aad8,segment=NetworkSegment(aa897a0e-2f5f-409f-9c54-e54d16b8acdf),segment_id=aa897a0e-2f5f-409f-9c54-e54d16b8acdf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:17.212113 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-61218949-bed7-4f96-9507-33e339d38ba1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.246257 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87'}], 'enable_snat': True}, 'gw_port_id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:03:12Z', 'revision_number': 4, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port': {'id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:fc:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_gateway', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:08Z', 'updated_at': '2022-01-05T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'aff7dea8-8427-4fbd-a092-874fdaa8aad8', 'name': '', 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'mac_address': 'fa:16:3e:52:30:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_interface', 'standard_attr_id': 418, 'fixed_ips': [{'subnet_id': '911a986a-d792-4f9a-89d1-a506c7e3b90e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:11Z', 'updated_at': '2022-01-05T15:03:16Z', 'revision_number': 4, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'subnets': [{'id': '911a986a-d792-4f9a-89d1-a506c7e3b90e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:17.270806 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-61218949-bed7-4f96-9507-33e339d38ba1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.276359 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-921f3325-6c59-4db9-92f9-9a6b619263a7 None None] The sync data for ids ['a3300cf8-c042-4d6e-a24f-3260216ca937'] in dv-cinder-master-3-iscsi is: [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87'}], 'enable_snat': True}, 'gw_port_id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:03:12Z', 'revision_number': 4, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port': {'id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:fc:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_gateway', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:08Z', 'updated_at': '2022-01-05T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'aff7dea8-8427-4fbd-a092-874fdaa8aad8', 'name': '', 'network_id': 'c1f8eb4e-612b-4878-8235-63de39015c64', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'mac_address': 'fa:16:3e:52:30:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_interface', 'standard_attr_id': 418, 'fixed_ips': [{'subnet_id': '911a986a-d792-4f9a-89d1-a506c7e3b90e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:11Z', 'updated_at': '2022-01-05T15:03:16Z', 'revision_number': 4, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'subnets': [{'id': '911a986a-d792-4f9a-89d1-a506c7e3b90e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:03:17.283585 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-59f1e9fa-ecdf-4476-939c-08d087e6fe55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.358104 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59f1e9fa-ecdf-4476-939c-08d087e6fe55 None None] Pushing event updated for resources: {'Port': ['ID=aff7dea8-8427-4fbd-a092-874fdaa8aad8,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:17.404639 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-61218949-bed7-4f96-9507-33e339d38ba1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.432061 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61218949-bed7-4f96-9507-33e339d38ba1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7331400a-0b41-4327-a9d6-bbed4e1f642c,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:17.444003 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e1bf08-b859-4575-a168-b1a4707f4189 req-69ef3217-6908-4128-a86c-2b16d14144b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:17.446819 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1e1bf08-b859-4575-a168-b1a4707f4189 req-69ef3217-6908-4128-a86c-2b16d14144b0 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 1102 time: 0.0702560 Jan 05 15:03:17.499418 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1e1bf08-b859-4575-a168-b1a4707f4189 req-d75fa334-2e53-452b-9e98-a64d4eb84aba service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424123 Jan 05 15:03:17.569197 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-61218949-bed7-4f96-9507-33e339d38ba1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.570421 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-61218949-bed7-4f96-9507-33e339d38ba1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5041137 Jan 05 15:03:17.573211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47288) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:17.578053 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'security_group_rule': {'security_group_id': '773a9e22-40c2-499c-8bf9-0e8887977b03', 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:17.714730 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.securitygroups_db [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Project c3797435200949c8a45be6c5b0525dc0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jan 05 15:03:17.720395 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.782439 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.895460 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.917406 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=adaca85e-6de3-433d-bdc2-9391f2411408,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:17.993173 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:17.998912 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b3f99d5a-3de0-46d1-bfab-26c37f3139d3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4204035 Jan 05 15:03:18.000123 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47292) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:18.003929 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710fd863-b402-4a2f-ba3f-984da4a71d16 req-458bf7bb-99df-453c-b07f-22be505e808a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:18.005411 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'security_group_rule': {'security_group_id': '773a9e22-40c2-499c-8bf9-0e8887977b03', 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:18.008276 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-710fd863-b402-4a2f-ba3f-984da4a71d16 req-458bf7bb-99df-453c-b07f-22be505e808a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 944 time: 0.0719399 Jan 05 15:03:18.070704 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-710fd863-b402-4a2f-ba3f-984da4a71d16 req-3b867e1c-3804-4c98-8a22-a711760800be tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561669 Jan 05 15:03:18.096682 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device aff7dea8-8427-4fbd-a092-874fdaa8aad8 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:18.175660 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a664fbc-5bf5-48a2-882b-e79664fde076 req-77d62447-78b4-4d67-8d8f-8c666750dacf tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:18.177868 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8a664fbc-5bf5-48a2-882b-e79664fde076 req-77d62447-78b4-4d67-8d8f-8c666750dacf tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 949 time: 0.0852582 Jan 05 15:03:18.179172 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.securitygroups_db [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Project c3797435200949c8a45be6c5b0525dc0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jan 05 15:03:18.199331 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:18.201381 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port aff7dea8-8427-4fbd-a092-874fdaa8aad8 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:18.202079 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:18.278962 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8a664fbc-5bf5-48a2-882b-e79664fde076 req-a784af5d-db3a-43d1-86b7-a449cad70e26 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897508 Jan 05 15:03:18.305957 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:18.394737 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:18.414739 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3966e839-d619-4567-a7b7-a5764b57d7cb,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:18.468859 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:18.470146 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-8b0834ba-55e7-4d9f-bfaa-48b0ba575800 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4712694 Jan 05 15:03:18.558707 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:03:18.662789 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:18.683254 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'port_id': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'mac_address': 'fa:16:3e:dc:e4:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:03:18.727154 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:18.740875 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:03:18.761083 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:18.815032 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:18.865741 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:19.161916 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['4bda96b8-bc6e-4586-8d4d-5a66846e4b96'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:03:19.243271 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78c3d3e-3b98-43cd-906e-9f65afd26694 req-d7f99b12-5fcd-4db6-a528-f44f9060651d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:19.244723 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b78c3d3e-3b98-43cd-906e-9f65afd26694 req-d7f99b12-5fcd-4db6-a528-f44f9060651d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 945 time: 0.0526204 Jan 05 15:03:19.297449 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b78c3d3e-3b98-43cd-906e-9f65afd26694 req-487f8faa-e27f-4260-8a07-c94272b8fa01 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458002 Jan 05 15:03:19.422761 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 req-1adf403d-2b38-4c7a-a1a1-7d732017172a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:19.424229 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 req-1adf403d-2b38-4c7a-a1a1-7d732017172a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 949 time: 0.0661740 Jan 05 15:03:19.473361 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f25fc01e-0113-4461-9c0d-0edaf2e214f8 req-c104c1ae-35a5-4ec3-8621-ffb90e358614 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423503 Jan 05 15:03:20.445532 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33452581-943b-4d83-ac5e-4c155a3a5b2e req-f5d33327-4479-4403-9774-411216e18c8c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:20.447736 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-33452581-943b-4d83-ac5e-4c155a3a5b2e req-f5d33327-4479-4403-9774-411216e18c8c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 945 time: 0.0786526 Jan 05 15:03:20.496932 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-33452581-943b-4d83-ac5e-4c155a3a5b2e req-d7178205-ba8b-4f58-b9d9-8584a0bc74a1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437796 Jan 05 15:03:20.509785 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b83470a-8429-43d9-89ca-badec535d52f req-33a34f6d-8967-406d-a617-a67fdf88c893 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:20.512409 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b83470a-8429-43d9-89ca-badec535d52f req-33a34f6d-8967-406d-a617-a67fdf88c893 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 949 time: 0.0622942 Jan 05 15:03:20.556873 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:03:20.563464 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b83470a-8429-43d9-89ca-badec535d52f req-02fefd62-6b6f-48c2-9875-441435dc8e36 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451035 Jan 05 15:03:20.993153 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:03:21.000344 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:21.000677 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:21.094053 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:21.117781 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:21.120035 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be84f337-d154-4715-a66a-d5549d1c06c0" -d '{"events": [{"server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "name": "network-vif-plugged", "status": "completed", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:21.132873 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:21.157284 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c x-openstack-request-id: req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:21.157597 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "name": "network-vif-plugged", "status": "completed", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:21.157854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8ffc68d2-cf99-4ea4-adad-b3c7cadbcc0c {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:21.158248 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'code': 200} Jan 05 15:03:21.217195 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:21.268918 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:21.527946 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb33a28-6769-4582-945f-777ac03d6a00 req-f05f9046-cefc-41a1-9705-a07eed64157f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:21.528935 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6fb33a28-6769-4582-945f-777ac03d6a00 req-f05f9046-cefc-41a1-9705-a07eed64157f service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1099 time: 0.0443790 Jan 05 15:03:21.591152 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6fb33a28-6769-4582-945f-777ac03d6a00 req-b0b5f33a-f665-4285-9791-739f66a60867 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488291 Jan 05 15:03:21.627763 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 req-a59243c9-b4a2-4c50-b1aa-d5e5e848eeea tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:21.629280 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 req-a59243c9-b4a2-4c50-b1aa-d5e5e848eeea tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0573423 Jan 05 15:03:21.677193 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6781939b-be43-4d20-8a67-2c95e9e8c1f6 req-c55bd2cd-a416-4dc7-96f0-8a8ad0e29c9a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424707 Jan 05 15:03:21.682443 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 req-a9f89e4f-586d-4263-89c4-a171af425a71 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:21.683935 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 req-a9f89e4f-586d-4263-89c4-a171af425a71 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 949 time: 0.0494220 Jan 05 15:03:21.731588 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-96ac2c39-e3a0-4bff-b8e9-7a41c4a71388 req-46c348fa-8e68-41c7-9de0-266943c82aee tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410311 Jan 05 15:03:22.794193 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8508b513-5c2e-4730-958c-a622c703b2d8 req-ac5dfea2-52d4-4db9-b6a8-a9c002a792de tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:22.795785 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8508b513-5c2e-4730-958c-a622c703b2d8 req-ac5dfea2-52d4-4db9-b6a8-a9c002a792de tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0520890 Jan 05 15:03:22.845801 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8508b513-5c2e-4730-958c-a622c703b2d8 req-851a8278-189d-4a09-96e4-07180725ee6f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437276 Jan 05 15:03:22.849809 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9feb3906-f42f-453a-9257-80ba6e14db47 req-074a89d5-fb9e-46e0-a40f-5a0d0147e56a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:22.851317 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9feb3906-f42f-453a-9257-80ba6e14db47 req-074a89d5-fb9e-46e0-a40f-5a0d0147e56a tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 949 time: 0.0511854 Jan 05 15:03:22.901484 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9feb3906-f42f-453a-9257-80ba6e14db47 req-5a9c03cc-27a7-4b88-84a4-b2b405c6f8cc tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/security-groups?id=1866185b-859f-4cdd-968a-604a5388536f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437477 Jan 05 15:03:23.378690 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-91d3c4fa-8a11-4dc6-b822-8058a2696831 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:23.389252 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-91d3c4fa-8a11-4dc6-b822-8058a2696831 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.13 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 949 time: 0.0678639 Jan 05 15:03:23.484737 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Deleting port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:03:23.485146 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:23.590168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] For port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,segment=NetworkSegment(1b024b10-d466-4bbb-8a27-b254862142ea),segment_id=1b024b10-d466-4bbb-8a27-b254862142ea)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:23.590536 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:23.603413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Calling delete_port for c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:03:23.812663 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:23.846004 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Pushing event deleted for resources: {'Port': ['ID=c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:23.862361 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:03:23.888341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] No DVR routers for this DVR port c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:03:23.892574 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:23.894448 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e354839d-1b6e-40ae-ac8b-8f85c8262348 req-0e13139c-6c31-480b-ab38-19ca7c1346da tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.13 "DELETE /v2.0/ports/c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 HTTP/1.1" status: 204 len: 173 time: 0.5072024 Jan 05 15:03:23.895084 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'name': 'network-vif-deleted', 'tag': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:23.897250 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ea80fd4-39c6-4e47-8edb-6b2e6b0a8ed9" -d '{"events": [{"server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "name": "network-vif-deleted", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:23.943228 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db703147-382f-4072-999b-a565efec266f x-openstack-request-id: req-db703147-382f-4072-999b-a565efec266f {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:23.943536 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d886f950-f714-4343-a8f9-7b22b8b21047", "name": "network-vif-deleted", "tag": "c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:23.943766 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-db703147-382f-4072-999b-a565efec266f {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:23.944156 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd886f950-f714-4343-a8f9-7b22b8b21047', 'name': 'network-vif-deleted', 'tag': 'c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8', 'status': 'completed', 'code': 200} Jan 05 15:03:23.997591 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfbdaa51-b7df-4b51-a192-52746270772d req-d61774b0-dd50-4127-96c0-7b356af0636f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:23.999704 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cfbdaa51-b7df-4b51-a192-52746270772d req-d61774b0-dd50-4127-96c0-7b356af0636f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0661857 Jan 05 15:03:24.035083 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2285b2ee-ad18-407a-be90-5cc8b4624ba1 req-33e60381-1298-402b-b390-7666b84b2982 tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 210 time: 0.0303040 Jan 05 15:03:24.058402 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cfbdaa51-b7df-4b51-a192-52746270772d req-e8213fa3-34c8-4482-ac55-e85c43c940e0 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480766 Jan 05 15:03:24.178545 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f278b61-f012-4b4b-87f6-c905c004f494 req-6dd6346f-f2be-472e-bcab-25efc979bc1e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:24.179932 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2f278b61-f012-4b4b-87f6-c905c004f494 req-6dd6346f-f2be-472e-bcab-25efc979bc1e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0522356 Jan 05 15:03:24.226895 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2f278b61-f012-4b4b-87f6-c905c004f494 req-d712e807-d27d-4f4c-b4f9-4b4c2ac7f0a2 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414135 Jan 05 15:03:24.551300 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f950730f-ce4c-4f5b-b904-d09486888893 req-3f2ee90e-9949-4bda-8c35-870e10f19036 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:24.552838 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f950730f-ce4c-4f5b-b904-d09486888893 req-3f2ee90e-9949-4bda-8c35-870e10f19036 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0486422 Jan 05 15:03:24.607366 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f950730f-ce4c-4f5b-b904-d09486888893 req-96a3ec8a-0619-4cbb-8a4b-91525e4ef385 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487695 Jan 05 15:03:25.165691 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fbc7d84a-47c9-4e5e-914c-9574d8165154 req-9759b1b0-82e9-453f-aa01-cba8b19e421d tempest-VolumesNegativeTest-299054243 tempest-VolumesNegativeTest-299054243-project] 10.222.0.30 "GET /v2.0/ports?device_id=d886f950-f714-4343-a8f9-7b22b8b21047 HTTP/1.1" status: 200 len: 210 time: 0.0371995 Jan 05 15:03:26.022248 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47482) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:26.128243 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9131d6f4-6ccd-4f29-a1be-8ae7b2ef8d68 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:26.198943 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9131d6f4-6ccd-4f29-a1be-8ae7b2ef8d68 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:26.297721 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9131d6f4-6ccd-4f29-a1be-8ae7b2ef8d68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:26.338395 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9131d6f4-6ccd-4f29-a1be-8ae7b2ef8d68 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9dcf9814e9b341a48dffd5d5cf728580&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3150418 Jan 05 15:03:26.339209 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9131d6f4-6ccd-4f29-a1be-8ae7b2ef8d68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a7fc4a1-f8d9-4eed-ad50-cc6cfc76860e,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:26.341029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47494) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:26.396236 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:26.417558 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:26.560288 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:26.563552 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:26.564735 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6a7fc4a1-f8d9-4eed-ad50-cc6cfc76860e HTTP/1.1" status: 204 len: 168 time: 0.2226770 Jan 05 15:03:26.573935 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a7fc4a1-f8d9-4eed-ad50-cc6cfc76860e,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:26.582494 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.582864 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.583151 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.583489 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.583824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.584152 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.584489 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.584811 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.585168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.585498 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.586234 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.586563 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.586920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80344932-c3e5-4b78-ada4-ac451952169e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:26.593413 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:03:26.623567 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:03:26.624745 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device c8d5a556-6e5f-4a4a-9476-0f5cc44c88c8 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:03:27.437087 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47590) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:27.450175 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bbe8ccdd-3467-4be5-ade6-cd431e30954a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:27.532381 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bbe8ccdd-3467-4be5-ade6-cd431e30954a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:27.617421 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bbe8ccdd-3467-4be5-ade6-cd431e30954a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:27.657101 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe8ccdd-3467-4be5-ade6-cd431e30954a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e96f17b-2c89-4103-b6d6-e71ad6bad71a,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:27.672372 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-bbe8ccdd-3467-4be5-ade6-cd431e30954a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bda5c991169d449fbf3e957eb34228f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2290826 Jan 05 15:03:27.672501 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47602) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:27.731207 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4f8acf87-2a3f-4727-ba2b-c51e520e6212 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:27.758026 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4f8acf87-2a3f-4727-ba2b-c51e520e6212 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:27.916841 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4f8acf87-2a3f-4727-ba2b-c51e520e6212 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:27.919530 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4f8acf87-2a3f-4727-ba2b-c51e520e6212 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:27.920735 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4f8acf87-2a3f-4727-ba2b-c51e520e6212 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0e96f17b-2c89-4103-b6d6-e71ad6bad71a HTTP/1.1" status: 204 len: 168 time: 0.2523680 Jan 05 15:03:27.930381 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8acf87-2a3f-4727-ba2b-c51e520e6212 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e96f17b-2c89-4103-b6d6-e71ad6bad71a,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:28.163606 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-d7e3ab6c-c879-46b4-afff-4d6e796e847f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:30.396545 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-c6aac23d-6bf7-4723-9028-fa20f7f90db4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:30.622437 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47766) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:30.747950 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-540011ea-4cbe-4e67-a9a0-3d2845eedc60 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:30.827625 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-540011ea-4cbe-4e67-a9a0-3d2845eedc60 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:30.902821 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-540011ea-4cbe-4e67-a9a0-3d2845eedc60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:30.945237 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-540011ea-4cbe-4e67-a9a0-3d2845eedc60 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2c06135fc8ef44298712e69b66cfa064&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3193662 Jan 05 15:03:30.945237 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540011ea-4cbe-4e67-a9a0-3d2845eedc60 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e8e582d-c4b9-4788-993f-04334016d594,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:30.946015 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47782) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:31.000790 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-08167c04-12ca-458b-823c-840c6f552111 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.022860 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-08167c04-12ca-458b-823c-840c6f552111 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.154759 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-08167c04-12ca-458b-823c-840c6f552111 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.159352 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-08167c04-12ca-458b-823c-840c6f552111 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.160521 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-08167c04-12ca-458b-823c-840c6f552111 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9e8e582d-c4b9-4788-993f-04334016d594 HTTP/1.1" status: 204 len: 168 time: 0.2135262 Jan 05 15:03:31.171268 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08167c04-12ca-458b-823c-840c6f552111 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e8e582d-c4b9-4788-993f-04334016d594,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:31.792582 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47826) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:31.805486 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7f00c87b-c344-4cec-b96c-605f74a104e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.806153 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.878153 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7f00c87b-c344-4cec-b96c-605f74a104e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.954345 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7f00c87b-c344-4cec-b96c-605f74a104e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:31.994267 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f00c87b-c344-4cec-b96c-605f74a104e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd4be72c-07b5-4bae-9a11-e54224fb6470,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:32.000236 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7f00c87b-c344-4cec-b96c-605f74a104e1 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f7fb6224dfc9469389aae2ad9c9eeecd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2065618 Jan 05 15:03:32.002854 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 47834) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:32.048211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18d2eef5-9845-4b21-92f5-069c8db1e446 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:32.073089 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18d2eef5-9845-4b21-92f5-069c8db1e446 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:32.255187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18d2eef5-9845-4b21-92f5-069c8db1e446 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:32.258134 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18d2eef5-9845-4b21-92f5-069c8db1e446 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:32.259570 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-18d2eef5-9845-4b21-92f5-069c8db1e446 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/bd4be72c-07b5-4bae-9a11-e54224fb6470 HTTP/1.1" status: 204 len: 168 time: 0.2556634 Jan 05 15:03:32.268924 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d2eef5-9845-4b21-92f5-069c8db1e446 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd4be72c-07b5-4bae-9a11-e54224fb6470,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:32.776923 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:33.161278 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47864) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:33.173485 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-626bb4b0-3f05-431d-9c71-b60b109b5e62 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0457802 Jan 05 15:03:33.251759 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-82c6c1b7-fb0a-4e3f-92ea-578fecbfca30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:33.253130 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-82c6c1b7-fb0a-4e3f-92ea-578fecbfca30 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 1100 time: 0.0415802 Jan 05 15:03:33.300227 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f7bca9bc-413f-4aa9-a3fe-3927c281fb0e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=27614f6e32454ccaa602817f1658ac5a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1361909 Jan 05 15:03:33.301172 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47872) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:33.349163 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:33.363785 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-08c431b1-bd4d-43be-a910-611e20f2be36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:33.365575 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-08c431b1-bd4d-43be-a910-611e20f2be36 service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.0908830 Jan 05 15:03:33.373263 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:33.438058 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-56369b94-38f3-4683-a75c-4fdeca86c1a8 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=45483c3c-9f42-4aff-a962-22ff36647afc HTTP/1.1" status: 200 len: 1002 time: 0.0657308 Jan 05 15:03:33.489758 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-ce437b66-07e8-4c2d-b11c-bf61fd2db50e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:33.491455 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-ce437b66-07e8-4c2d-b11c-bf61fd2db50e service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0465457 Jan 05 15:03:33.517889 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:33.521320 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:33.521771 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:33.524529 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1866185b-859f-4cdd-968a-604a5388536f HTTP/1.1" status: 204 len: 168 time: 0.2224278 Jan 05 15:03:33.534861 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1866185b-859f-4cdd-968a-604a5388536f,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:33.542780 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-f62c6fd4-27d7-42d6-b9d8-6ddce9d601f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:33.544472 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-f62c6fd4-27d7-42d6-b9d8-6ddce9d601f7 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0464289 Jan 05 15:03:33.545216 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.546270 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.549736 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.550839 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.550839 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd11a1d9-6942-46a7-8c89-85088f067c2e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:33.639021 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-cfe0612a-2be5-4577-b8c9-dc65a3782e6a service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868361 Jan 05 15:03:33.742390 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b7829cd3-27ab-45c7-8c7f-2c9f00efd589 req-b924f1bd-6efc-4746-9f37-55c73d15e21a service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912020 Jan 05 15:03:34.411509 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:36.949835 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76777fdc-8fd2-4106-81bd-019c124b6ff7 req-5fc462ec-7bd5-4f35-98ac-dfeec0a462bb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:36.951340 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-76777fdc-8fd2-4106-81bd-019c124b6ff7 req-5fc462ec-7bd5-4f35-98ac-dfeec0a462bb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0538754 Jan 05 15:03:36.998111 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-76777fdc-8fd2-4106-81bd-019c124b6ff7 req-451f18f2-82fb-4235-a707-b8e6e453eb7c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404930 Jan 05 15:03:37.026446 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47984) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:37.207494 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-169d9e26-86fc-461a-8024-1a803aa901f8 tempest-TestMinimumBasicScenario-1134769304 tempest-TestMinimumBasicScenario-1134769304-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:37.210097 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-169d9e26-86fc-461a-8024-1a803aa901f8 tempest-TestMinimumBasicScenario-1134769304 tempest-TestMinimumBasicScenario-1134769304-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1094 time: 0.1871395 Jan 05 15:03:37.217651 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 47994) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:37.222365 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'port_id': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'fixed_ip_address': '172.20.0.11'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:37.343400 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-5d3e3a3d-1576-409e-ac64-6ade8113d312 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1412084070&fields=id&tenant_id=c3797435200949c8a45be6c5b0525dc0 HTTP/1.1" status: 200 len: 267 time: 0.0440111 Jan 05 15:03:37.348875 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:37.446920 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.447254 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:03:37.449702 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:03:37.450527 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-7e642d9b-6b56-4004-95b8-eb9e0593a417 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:37.451302 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-7e642d9b-6b56-4004-95b8-eb9e0593a417 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 808 time: 0.1014855 Jan 05 15:03:37.465659 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-df8c78b1-cdd7-428f-b2ad-869028a9fc4b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/quotas/c3797435200949c8a45be6c5b0525dc0 HTTP/1.1" status: 200 len: 375 time: 0.0090606 Jan 05 15:03:37.520781 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-44213ab8-3772-4555-9ee6-b1b12c32efc3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0499244 Jan 05 15:03:37.552935 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Allocated IP 172.37.2.27 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/02cf9cef-0f4f-4154-a19c-cb823e93b90a) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:37.613468 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-0fefbe59-8fac-408c-910d-8aeda8a30eeb service neutron] 10.222.0.30 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813704 Jan 05 15:03:37.655849 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:37.704713 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-56a39002-0dca-44cd-b631-7ee363078a22 service neutron] 10.222.0.30 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853782 Jan 05 15:03:37.760549 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:37.797179 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:37.800143 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:37.803834 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:37.830592 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'Port': ['ID=02cf9cef-0f4f-4154-a19c-cb823e93b90a,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:38.270649 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:38.643569 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-057c0c97-0065-40cd-98ac-2a5d549d846c req-5362f866-7d5c-48fc-83e9-708aec0a912a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 210 time: 0.2518260 Jan 05 15:03:38.669539 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:38.815701 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:38.877300 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:38.944251 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'Port': ['ID=02cf9cef-0f4f-4154-a19c-cb823e93b90a,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:38.954202 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:39.054312 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Floating IP b48e1723-803e-4342-87a9-9162f75d5313 associated. External IP: 172.37.2.27, port: 4bda96b8-bc6e-4586-8d4d-5a66846e4b96. Jan 05 15:03:39.257126 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:03:39.363938 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:03:39.373863 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] Sync routers for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:03:39.383529 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:39.384189 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:39.453504 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:39.480346 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-29fc10c9-cab0-44d8-9144-a3c1f2acdc48 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2616313 Jan 05 15:03:39.480945 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:39.483741 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48030) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:39.484227 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d78717f-94fa-4ea9-bc12-313bc9b5777f" -d '{"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:39.488691 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-2fee2fdb-f912-492e-9d7f-a1a6c005413c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1780740953', 'description': 'tempest-secgroup-smoke-1780740953 description', 'project_id': 'b874b608d2c848a88541148e56d2114d'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:39.496058 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:39.521047 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54315eaa-14a4-4113-9812-b386ff5990c0 x-openstack-request-id: req-54315eaa-14a4-4113-9812-b386ff5990c0 {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:39.521365 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:39.521625 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-54315eaa-14a4-4113-9812-b386ff5990c0 {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:39.522032 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'status': 'completed', 'code': 200} Jan 05 15:03:39.586547 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fee2fdb-f912-492e-9d7f-a1a6c005413c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:39.651433 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fee2fdb-f912-492e-9d7f-a1a6c005413c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:39.718218 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fee2fdb-f912-492e-9d7f-a1a6c005413c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:39.737315 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-287ef6df-3c38-4a6c-a532-6647c0b21a66 req-5bf0dbc9-5f7e-40f8-9b5c-881d39a13b5c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 210 time: 0.0284851 Jan 05 15:03:39.751870 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fee2fdb-f912-492e-9d7f-a1a6c005413c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2767f584-b06b-4dab-a69f-33162778019e,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:39.779252 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'b48e1723-803e-4342-87a9-9162f75d5313', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'floating_ip_address': '172.37.2.27', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'port_id': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 449, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'mac_address': 'fa:16:3e:dc:e4:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '22497ce1-6400-4f16-a962-dce627a97693', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:38Z', 'updated_at': '2022-01-05T15:03:38Z', 'revision_number': 0, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:20Z', 'revision_number': 5, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:39.801707 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] Checking router: 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:03:39.809731 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:39.810319 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:39.824824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2fee2fdb-f912-492e-9d7f-a1a6c005413c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:39.826201 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2fee2fdb-f912-492e-9d7f-a1a6c005413c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3412473 Jan 05 15:03:39.830119 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48036) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:39.834816 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-3715ea50-193c-4350-a100-a0d471316813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'security_group_rule': {'security_group_id': '2767f584-b06b-4dab-a69f-33162778019e', 'project_id': 'b874b608d2c848a88541148e56d2114d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:39.924975 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3715ea50-193c-4350-a100-a0d471316813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:39.987561 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3715ea50-193c-4350-a100-a0d471316813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.034915 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:40.094584 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3715ea50-193c-4350-a100-a0d471316813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.116105 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3715ea50-193c-4350-a100-a0d471316813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=30490e0e-8029-49eb-99cc-ec60be78d759,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:40.196119 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3715ea50-193c-4350-a100-a0d471316813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.199906 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-3715ea50-193c-4350-a100-a0d471316813 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3661430 Jan 05 15:03:40.200248 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48040) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:40.205157 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-50d6a98b-b978-4942-a0fb-291e945b31fd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'security_group_rule': {'security_group_id': '2767f584-b06b-4dab-a69f-33162778019e', 'project_id': 'b874b608d2c848a88541148e56d2114d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:40.255647 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'b48e1723-803e-4342-87a9-9162f75d5313', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'floating_ip_address': '172.37.2.27', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'port_id': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 449, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'mac_address': 'fa:16:3e:dc:e4:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '22497ce1-6400-4f16-a962-dce627a97693', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:38Z', 'updated_at': '2022-01-05T15:03:38Z', 'revision_number': 0, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:20Z', 'revision_number': 5, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:40.282385 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a7d103-6dfb-404b-8786-65af4d5b0576 None None] The sync data for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi is: [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'b48e1723-803e-4342-87a9-9162f75d5313', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'floating_ip_address': '172.37.2.27', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'port_id': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 449, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'mac_address': 'fa:16:3e:dc:e4:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '22497ce1-6400-4f16-a962-dce627a97693', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:38Z', 'updated_at': '2022-01-05T15:03:38Z', 'revision_number': 0, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:20Z', 'revision_number': 5, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:03:40.300207 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-50d6a98b-b978-4942-a0fb-291e945b31fd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.368985 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-50d6a98b-b978-4942-a0fb-291e945b31fd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.421486 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-c045e5bf-ec41-4bc3-8fdb-eaca50ee2d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:40.423011 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-c045e5bf-ec41-4bc3-8fdb-eaca50ee2d2a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1099 time: 0.0540612 Jan 05 15:03:40.433005 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-50d6a98b-b978-4942-a0fb-291e945b31fd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.469952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50d6a98b-b978-4942-a0fb-291e945b31fd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=94c3610c-19b6-489f-9941-2d35281110fd,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:40.509601 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c36fb71-728b-4792-990e-1b24bc019da0 None None] New status for floating IP b48e1723-803e-4342-87a9-9162f75d5313: ACTIVE {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:03:40.552217 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-430fc01e-4ed1-41e8-a36e-8b766945b32d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:40.552217 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-430fc01e-4ed1-41e8-a36e-8b766945b32d service neutron] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 915 time: 0.1144085 Jan 05 15:03:40.599400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-50d6a98b-b978-4942-a0fb-291e945b31fd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.600663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-50d6a98b-b978-4942-a0fb-291e945b31fd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3992982 Jan 05 15:03:40.603440 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48050) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:40.618527 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-9a206a9b-a17c-4683-994c-446cf24ee8a7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'security_group_rule': {'security_group_id': '2767f584-b06b-4dab-a69f-33162778019e', 'project_id': 'b874b608d2c848a88541148e56d2114d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:40.626459 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-97de5b40-786e-47df-bb50-8461836734e4 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 999 time: 0.0715637 Jan 05 15:03:40.682088 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-dfa23254-4dc4-4951-8d75-627c597d1918 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:40.683561 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-dfa23254-4dc4-4951-8d75-627c597d1918 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.0511310 Jan 05 15:03:40.723484 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9a206a9b-a17c-4683-994c-446cf24ee8a7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.751485 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-fb07c5a5-beaf-4fc0-8d8d-1b8a2e22848e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:40.752977 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-fb07c5a5-beaf-4fc0-8d8d-1b8a2e22848e service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0519919 Jan 05 15:03:40.790364 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9a206a9b-a17c-4683-994c-446cf24ee8a7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.857461 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-79142f02-6604-44ed-b51e-9e9a3be48479 req-9babf160-133e-4b1c-8992-b292bde5039c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 210 time: 0.0325830 Jan 05 15:03:40.879448 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9a206a9b-a17c-4683-994c-446cf24ee8a7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.892210 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-28f8b4e8-3943-4e5d-ac1e-f004fa5143d5 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1318123 Jan 05 15:03:40.898907 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a206a9b-a17c-4683-994c-446cf24ee8a7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=951b59d8-2cea-4928-a30f-db82f3f3c64c,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:40.983531 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7d78717f-94fa-4ea9-bc12-313bc9b5777f req-0026ea55-2bbd-450c-88c5-f110abf0ba35 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833600 Jan 05 15:03:40.996301 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9a206a9b-a17c-4683-994c-446cf24ee8a7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:40.997538 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9a206a9b-a17c-4683-994c-446cf24ee8a7 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3927746 Jan 05 15:03:41.000789 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48060) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:41.006036 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-8a95abee-32d1-4069-9801-1c9ea5bd3e08 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'security_group_rule': {'security_group_id': '2767f584-b06b-4dab-a69f-33162778019e', 'project_id': 'b874b608d2c848a88541148e56d2114d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:41.122700 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a95abee-32d1-4069-9801-1c9ea5bd3e08 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.182901 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a95abee-32d1-4069-9801-1c9ea5bd3e08 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.268608 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a95abee-32d1-4069-9801-1c9ea5bd3e08 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.285787 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a95abee-32d1-4069-9801-1c9ea5bd3e08 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2a766ea7-cb7a-4401-8918-ec94a66a803f,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:41.360148 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-8a95abee-32d1-4069-9801-1c9ea5bd3e08 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.365746 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48072) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:41.371429 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'security_group_rule': {'security_group_id': '2767f584-b06b-4dab-a69f-33162778019e', 'project_id': 'b874b608d2c848a88541148e56d2114d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:41.376685 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-8a95abee-32d1-4069-9801-1c9ea5bd3e08 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3747888 Jan 05 15:03:41.457146 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.securitygroups_db [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Project b874b608d2c848a88541148e56d2114d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jan 05 15:03:41.463220 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.532614 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.652566 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.673359 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9eb82919-1838-4dad-9690-7e6a8dad87f7,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:41.710804 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-3cc751e1-26d8-48ba-9f93-dce8a0cd2f6a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:41.712236 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-3cc751e1-26d8-48ba-9f93-dce8a0cd2f6a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.13 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 808 time: 0.1141973 Jan 05 15:03:41.783167 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.789260 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-dd4e4c81-a7fc-4ba6-8378-5427db02964e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4222150 Jan 05 15:03:41.794134 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48082) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:41.799478 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'security_group_rule': {'security_group_id': '2767f584-b06b-4dab-a69f-33162778019e', 'project_id': 'b874b608d2c848a88541148e56d2114d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:41.802411 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-624a7f53-e6ad-4485-bd39-b92a02fbc765 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c3797435200949c8a45be6c5b0525dc0 HTTP/1.1" status: 200 len: 380 time: 0.0695481 Jan 05 15:03:41.821782 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'port': {'device_id': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'admin_state_up': True, 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'security_groups': ['773a9e22-40c2-499c-8bf9-0e8887977b03']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:41.915128 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.securitygroups_db [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Project b874b608d2c848a88541148e56d2114d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jan 05 15:03:41.927747 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:41.978563 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-31cc2d28-22e0-46c5-9a3c-1212ece39d45 req-10f385a1-77f4-4dfb-8394-1adebef4f95b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 210 time: 0.0438960 Jan 05 15:03:42.025010 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.045356 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec01fda-18cd-4730-8aac-afe79a704622 req-6e05ae4a-4aee-4ee3-b12d-a08e15f906c3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:42.046899 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ec01fda-18cd-4730-8aac-afe79a704622 req-6e05ae4a-4aee-4ee3-b12d-a08e15f906c3 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0740454 Jan 05 15:03:42.095094 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ec01fda-18cd-4730-8aac-afe79a704622 req-7ab1a56b-0bfd-496a-8255-c5a45b2c4f8f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427036 Jan 05 15:03:42.114081 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Made reservation on behalf of c3797435200949c8a45be6c5b0525dc0 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:03:42.117900 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.137179 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.151971 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb1805ef-ac2c-4b96-b6a5-9de083b694a8,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:42.252481 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Allocated IP 172.20.0.4 (e5205e82-a517-4157-848a-78560d0d2806/c3f10689-3a61-4de7-8ebe-99aa4c5a6a83/b7c14da5-847f-4d0d-9e0e-5c9ad34c581c) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:42.262377 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.273248 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1c62ac7e-0a62-4419-ab81-576fd653d5f8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4683077 Jan 05 15:03:42.412846 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-a7dee6ba-f658-4fea-a369-83a7889ebdbc tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1780740953&fields=id&tenant_id=b874b608d2c848a88541148e56d2114d HTTP/1.1" status: 200 len: 267 time: 0.0758333 Jan 05 15:03:42.432539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.488051 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-20350351-e4f9-4e7e-bed3-9e33f4ea7e5d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:42.489531 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-20350351-e4f9-4e7e-bed3-9e33f4ea7e5d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0688419 Jan 05 15:03:42.500901 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'port': {'security_groups': ['93cf9114-46da-4d77-8e9e-dda0c5b575f3', '2767f584-b06b-4dab-a69f-33162778019e']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:42.561736 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.601409 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.622548 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Network e5205e82-a517-4157-848a-78560d0d2806 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:42.630069 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:42.634594 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:42.654565 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:42.728477 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:42.729456 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.887442 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-24e865e6-5d94-4468-8245-eefcbb00936c None None] Provisioning complete for port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:42.888046 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-24e865e6-5d94-4468-8245-eefcbb00936c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:42.923380 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-24e865e6-5d94-4468-8245-eefcbb00936c None None] Port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:03:43.083262 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:43.291290 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-9d263a2b-8c53-480f-a874-801d4a68112a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2708340 Jan 05 15:03:43.291728 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 req-3761b316-53c4-47fc-a7c2-3aedb1f649e5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:43.291728 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 req-3761b316-53c4-47fc-a7c2-3aedb1f649e5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 931 time: 0.0603187 Jan 05 15:03:43.292366 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:43.292463 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f4d5df4e-8609-49f7-b8c9-8c2b445b9623 req-3e985ec7-3e14-43d0-8c5d-77faca61b196 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478647 Jan 05 15:03:43.292463 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc req-6a9b183e-d8cc-4514-ba63-29fef4459284 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:43.292463 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc req-6a9b183e-d8cc-4514-ba63-29fef4459284 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0477757 Jan 05 15:03:43.315705 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c55b2e29-591a-4cad-86ea-5c2ce64ac0fc req-07de8a53-537c-4580-ae6c-152c4015f85b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429876 Jan 05 15:03:43.354233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:43.398756 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:43.399370 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:43.400767 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-67a9f1f3-065f-4c8d-85ff-f79b409b1ebb req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "PUT /v2.0/ports/4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 982 time: 0.9050791 Jan 05 15:03:43.403622 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:43.406615 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-454570a2-c972-4608-a56c-290409086e92" -d '{"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:43.454079 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21d4c62-1c37-423a-a34a-6e58a9b393bf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=6']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:43.454079 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b x-openstack-request-id: req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:43.454079 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:43.454079 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-23d4cbc9-5c98-4ff8-a0ee-2acae8fa7b8b {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:43.454079 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'status': 'completed', 'code': 200} Jan 05 15:03:43.513657 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef req-7f38229e-2099-4084-84d0-914b3134516b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:43.515746 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef req-7f38229e-2099-4084-84d0-914b3134516b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0516138 Jan 05 15:03:43.578238 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-447a5a74-d2ec-4db1-8db9-d325fdb7bfef req-f2cfdbcf-9e73-4eda-9826-2c53007c4cf4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0565677 Jan 05 15:03:43.647404 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-639b3c3e-02d5-4dc2-a641-311a21baaacd None None] Provisioning complete for port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:03:43.647771 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-639b3c3e-02d5-4dc2-a641-311a21baaacd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:44.282022 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea req-a54bea85-0cec-485a-85f4-3b7bd3b78c7f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:44.283461 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea req-a54bea85-0cec-485a-85f4-3b7bd3b78c7f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 931 time: 0.0483336 Jan 05 15:03:44.330914 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a1b82d54-9075-4c62-8bcf-6e4af662c9ea req-5b00f020-f93c-420f-91a5-5168fabe11f5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420187 Jan 05 15:03:44.428215 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28013a7-3584-4a28-849f-94676f3fffd5 req-c9bfda67-426b-4f82-8ac9-fea207c71f07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:44.429742 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c28013a7-3584-4a28-849f-94676f3fffd5 req-c9bfda67-426b-4f82-8ac9-fea207c71f07 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0491357 Jan 05 15:03:44.474901 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c28013a7-3584-4a28-849f-94676f3fffd5 req-1135cea0-24e8-4c42-b2ad-c40178e913c5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396473 Jan 05 15:03:45.053330 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Request body: {'port': {'device_id': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:45.088682 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['4bda96b8-bc6e-4586-8d4d-5a66846e4b96'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:03:45.141057 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:45.150952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-454570a2-c972-4608-a56c-290409086e92 req-79d6bf77-5606-4e88-9c69-04ed9a980962 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:45.152412 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-79d6bf77-5606-4e88-9c69-04ed9a980962 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1138 time: 0.0810864 Jan 05 15:03:45.243678 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['4bda96b8-bc6e-4586-8d4d-5a66846e4b96'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:03:45.350478 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-454570a2-c972-4608-a56c-290409086e92 req-24474a69-322e-4aea-b460-237da9510157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:45.351949 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-24474a69-322e-4aea-b460-237da9510157 service neutron] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 915 time: 0.1926076 Jan 05 15:03:45.489247 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-f7653a08-1a88-4db4-916b-89fd3e4bc97d service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 1001 time: 0.1273026 Jan 05 15:03:45.581533 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d9a981-1045-45dd-863e-3833f1e5d716 req-d85f5a86-9572-4ef3-9fb6-762313033b6c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:45.583512 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-86d9a981-1045-45dd-863e-3833f1e5d716 req-d85f5a86-9572-4ef3-9fb6-762313033b6c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 931 time: 0.1575072 Jan 05 15:03:45.621924 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30a25516-79e9-4327-88f2-53580aeb3915 req-302f65ad-ef67-4f46-80f2-fe43ebb402e7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:45.623476 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-30a25516-79e9-4327-88f2-53580aeb3915 req-302f65ad-ef67-4f46-80f2-fe43ebb402e7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0789795 Jan 05 15:03:45.624097 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-454570a2-c972-4608-a56c-290409086e92 req-75ceac12-6398-4f68-953f-c66d823fb9c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:45.626013 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-75ceac12-6398-4f68-953f-c66d823fb9c8 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.1212833 Jan 05 15:03:45.707210 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-30a25516-79e9-4327-88f2-53580aeb3915 req-297a1467-a3b2-4b98-bf0a-bd1a47e44873 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0764654 Jan 05 15:03:45.736512 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-86d9a981-1045-45dd-863e-3833f1e5d716 req-d48968aa-af70-4121-b941-89c7558d2792 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1418922 Jan 05 15:03:45.753451 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b7c14da5-847f-4d0d-9e0e-5c9ad34c581c {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:03:45.763052 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:45.777981 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-454570a2-c972-4608-a56c-290409086e92 req-4c81850f-7e44-4474-9be2-8dd1b96b5bbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:45.779522 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-4c81850f-7e44-4474-9be2-8dd1b96b5bbc service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1130636 Jan 05 15:03:45.782612 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Transition to ACTIVE for port object b7c14da5-847f-4d0d-9e0e-5c9ad34c581c will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:03:45.860936 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:45.963923 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:45.974743 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:03:45.991554 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-d88bf868-6500-461c-ae2a-1acd9d052a0d service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1782730 Jan 05 15:03:46.074170 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Attempting to bind port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:03:46.074506 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Attempting to bind port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:03:46.074833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Attempting to bind port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c on network e5205e82-a517-4157-848a-78560d0d2806 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:46.084253 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c on network e5205e82-a517-4157-848a-78560d0d2806 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:03:46.084583 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Attempting to bind port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c on network e5205e82-a517-4157-848a-78560d0d2806 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:03:46.106078 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:03:46.106078 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Checking segment: {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:03:46.106078 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Bound using segment: {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:03:46.106573 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Bound port: b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:03:46.106925 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:46.127417 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-454570a2-c972-4608-a56c-290409086e92 req-c93b0240-ada2-4f74-9bbe-e03a2900a7bc service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1270227 Jan 05 15:03:46.179792 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:03:46.182928 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:03:46.303539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:46.321192 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:46.322250 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:46.325881 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] 10.222.0.13 "PUT /v2.0/ports/b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 1093 time: 1.2770555 Jan 05 15:03:46.349990 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:46.349990 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd58804e-3942-420d-937f-f358b849d089" -d '{"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:46.407268 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1eb2d114-5268-49ac-986c-965974de5d2e x-openstack-request-id: req-1eb2d114-5268-49ac-986c-965974de5d2e {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:46.407865 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:46.407989 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1eb2d114-5268-49ac-986c-965974de5d2e {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:46.408302 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'status': 'completed', 'code': 200} Jan 05 15:03:46.433401 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e2ae70-cea4-4682-9d3a-3ba42a7cbc68 service neutron] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:46.460492 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f04b827-2208-4711-b049-11bd1066109f req-bd015789-cb58-4dd9-8f1a-80f5e28885b4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:46.462194 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3f04b827-2208-4711-b049-11bd1066109f req-bd015789-cb58-4dd9-8f1a-80f5e28885b4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.0650520 Jan 05 15:03:46.571676 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd58804e-3942-420d-937f-f358b849d089 req-6d1a1106-c2b0-478e-a211-15f51c33cbd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:46.574524 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dd58804e-3942-420d-937f-f358b849d089 req-6d1a1106-c2b0-478e-a211-15f51c33cbd5 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1096 time: 0.1112070 Jan 05 15:03:46.667894 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Deleting port 2886de19-8aa3-470c-a593-9381bdb36ca0 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:03:46.668233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:46.754361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd58804e-3942-420d-937f-f358b849d089 req-f66559c8-a095-4039-9279-bceff5067752 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:46.755843 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dd58804e-3942-420d-937f-f358b849d089 req-f66559c8-a095-4039-9279-bceff5067752 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=c3797435200949c8a45be6c5b0525dc0&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1663830 Jan 05 15:03:46.838186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] For port 2886de19-8aa3-470c-a593-9381bdb36ca0, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2886de19-8aa3-470c-a593-9381bdb36ca0,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:46.838552 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:46.925668 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ea3431-de34-4576-b892-baa4299f5b9e req-5d734e62-3497-4369-856a-d6e550f3acc4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:46.927136 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d2ea3431-de34-4576-b892-baa4299f5b9e req-5d734e62-3497-4369-856a-d6e550f3acc4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 945 time: 0.1500247 Jan 05 15:03:47.043111 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d2ea3431-de34-4576-b892-baa4299f5b9e req-1a0071c1-1f68-4dc6-aef3-4354d7dfdb65 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=552b70d6-a366-4dff-9b66-b1679ffedd08&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1104238 Jan 05 15:03:47.119614 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:47.119983 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:47.120318 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Floating IP 6c329830-7016-424d-a758-395eb597052f disassociated. External IP: 172.37.2.32, port: 2886de19-8aa3-470c-a593-9381bdb36ca0. Jan 05 15:03:47.120646 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling delete_port for 2886de19-8aa3-470c-a593-9381bdb36ca0 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:03:47.138411 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0b596bc-b801-4113-b8a1-3c8e74094990 req-106ae5a2-d59f-4c00-82a8-fd114e4e36ef tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:47.140193 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e0b596bc-b801-4113-b8a1-3c8e74094990 req-106ae5a2-d59f-4c00-82a8-fd114e4e36ef tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0560191 Jan 05 15:03:47.194422 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e0b596bc-b801-4113-b8a1-3c8e74094990 req-56eaf448-6a08-4e96-b6ba-2e5ade5d4d74 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465002 Jan 05 15:03:47.202349 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5f9260-b072-4ea7-b01e-95403a185857 req-bb59d051-4e6e-4eb4-8808-86dfbbbbecb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:47.203865 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2e5f9260-b072-4ea7-b01e-95403a185857 req-bb59d051-4e6e-4eb4-8808-86dfbbbbecb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.1023393 Jan 05 15:03:47.269765 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2e5f9260-b072-4ea7-b01e-95403a185857 req-fbf6d5c1-9ce4-461f-8d19-9570d4eabddf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599213 Jan 05 15:03:47.380584 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:47.407740 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event deleted for resources: {'Port': ['ID=2886de19-8aa3-470c-a593-9381bdb36ca0,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:47.527235 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Router d3c49f70-ad09-435c-bdeb-024562318429 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:03:47.633979 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:03:47.643881 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] Sync routers for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:03:47.653966 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:47.654594 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:47.671815 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] No DVR routers for this DVR port 2886de19-8aa3-470c-a593-9381bdb36ca0 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:03:47.674279 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:47.677590 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3f04b827-2208-4711-b049-11bd1066109f req-8ad87f11-e8ff-4343-8119-3e453319d567 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "DELETE /v2.0/ports/2886de19-8aa3-470c-a593-9381bdb36ca0 HTTP/1.1" status: 204 len: 173 time: 1.2037103 Jan 05 15:03:47.767126 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:47.964953 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:47.996380 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] Checking router: d3c49f70-ad09-435c-bdeb-024562318429 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:03:48.004668 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:48.005294 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:48.112897 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:48.138943 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f1f18dcc-660f-4e5e-920f-571802a9562f req-8bc875b9-8ab0-4536-a24f-873fa8d0819e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.0265975 Jan 05 15:03:48.317863 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:48.318802 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 req-75516ba7-f9da-434f-a4f7-ad4bf39c938a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:48.320314 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 req-75516ba7-f9da-434f-a4f7-ad4bf39c938a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0541561 Jan 05 15:03:48.345563 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebb1c319-87aa-4619-8280-f943ae361fd0 None None] The sync data for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi is: [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:03:48.374287 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4f1b8dc2-9ef9-40fa-b8b8-50043872b256 req-ffa7a71e-cfaa-45ef-b1c0-16c667d2e817 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469160 Jan 05 15:03:48.403259 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680da7d5-59a1-49f1-8434-d485f2eb319e req-9e17c44f-fc5e-4d5a-88a8-933961ccbc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:48.404778 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-680da7d5-59a1-49f1-8434-d485f2eb319e req-9e17c44f-fc5e-4d5a-88a8-933961ccbc01 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0578384 Jan 05 15:03:48.409029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'name': 'network-vif-deleted', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:48.411326 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-913f48da-c63b-4e5e-869d-e97a6e63a99c" -d '{"events": [{"server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "name": "network-vif-deleted", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:48.454609 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6af96b2e-6569-4242-a75d-444a99616f3e x-openstack-request-id: req-6af96b2e-6569-4242-a75d-444a99616f3e {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:48.454909 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3327c27f-a8e9-4b19-8041-fb5260278159", "name": "network-vif-deleted", "tag": "2886de19-8aa3-470c-a593-9381bdb36ca0", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:48.455163 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6af96b2e-6569-4242-a75d-444a99616f3e {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:48.455559 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3327c27f-a8e9-4b19-8041-fb5260278159', 'name': 'network-vif-deleted', 'tag': '2886de19-8aa3-470c-a593-9381bdb36ca0', 'status': 'completed', 'code': 200} Jan 05 15:03:48.458781 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-680da7d5-59a1-49f1-8434-d485f2eb319e req-5cdd029d-33a0-4cba-b21e-ac6e1999095b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469494 Jan 05 15:03:48.597843 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c58aa514-fd47-4ae6-aa58-197dd1f9f76c None None] New status for floating IP 6c329830-7016-424d-a758-395eb597052f: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:03:49.242172 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f6acb3c1-da2d-494d-aadd-0b6ca74ba8b5 req-cfb9d145-5f6d-4539-bdff-8231ca3d78af tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.0266376 Jan 05 15:03:49.521705 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b464d0-1f96-4000-ae4c-0ff374995345 req-fc529d0b-71b2-4bce-876f-685fcc3bb987 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:49.528786 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a4b464d0-1f96-4000-ae4c-0ff374995345 req-fc529d0b-71b2-4bce-876f-685fcc3bb987 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0664113 Jan 05 15:03:49.573627 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd58804e-3942-420d-937f-f358b849d089 req-417983ed-ecca-4ead-ac89-80196f5d5eda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:49.575172 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dd58804e-3942-420d-937f-f358b849d089 req-417983ed-ecca-4ead-ac89-80196f5d5eda service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1519368 Jan 05 15:03:49.601893 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a4b464d0-1f96-4000-ae4c-0ff374995345 req-72ebb8f6-a3d0-46c3-b5c9-d5a25d22198a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0721576 Jan 05 15:03:49.651436 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca900a7-8ecf-4048-95c1-f09325638398 req-147806ae-1597-46b4-a1e8-d76cc9b05c62 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:49.661894 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fca900a7-8ecf-4048-95c1-f09325638398 req-147806ae-1597-46b4-a1e8-d76cc9b05c62 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0914726 Jan 05 15:03:49.702992 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fca900a7-8ecf-4048-95c1-f09325638398 req-cac90ed8-454a-465e-ab64-a8a82142f06f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442011 Jan 05 15:03:49.770088 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-1d960181-47e6-476f-9251-843ea3037eab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:49.771603 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-1d960181-47e6-476f-9251-843ea3037eab service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1096 time: 0.0463777 Jan 05 15:03:49.836898 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-c099f80d-93f7-4c7b-bb99-944a70a0250d service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 217 time: 0.0488081 Jan 05 15:03:49.887864 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-e92cdd06-85eb-45bc-b387-ce68c5b96fdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:49.889390 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-e92cdd06-85eb-45bc-b387-ce68c5b96fdd service neutron] 10.222.0.13 "GET /v2.0/subnets?id=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 200 len: 847 time: 0.0462649 Jan 05 15:03:49.938665 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-c63fd5d9-c519-45dc-a96a-34025cc2e203 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:49.940358 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-c63fd5d9-c519-45dc-a96a-34025cc2e203 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=e5205e82-a517-4157-848a-78560d0d2806&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0434549 Jan 05 15:03:50.043224 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-7c4f9510-82f3-467a-a582-2a0169cb7184 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836761 Jan 05 15:03:50.142088 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b546b629-51e3-45f0-9064-ee4beb85b993 req-d7747a10-db61-49bd-9851-7c124eb826d3 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922654 Jan 05 15:03:50.404090 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7af04bc3-e424-435a-9e3b-444ed7ecc68e req-f290c826-47e9-4293-8291-2dcbb0208ffd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=3327c27f-a8e9-4b19-8041-fb5260278159 HTTP/1.1" status: 200 len: 210 time: 0.0293369 Jan 05 15:03:50.733006 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa7b26f-90b7-4f1c-8514-705f2078b455 req-dd890d0e-90f6-4ce7-96ef-fad84708d98f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:50.742755 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7fa7b26f-90b7-4f1c-8514-705f2078b455 req-dd890d0e-90f6-4ce7-96ef-fad84708d98f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0678148 Jan 05 15:03:50.862711 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7fa7b26f-90b7-4f1c-8514-705f2078b455 req-392d7f8a-580c-4033-9718-9981a3b026a3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1193366 Jan 05 15:03:50.921330 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c req-d19a47c8-4c69-4ea4-97c9-7d9e13644483 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:50.921330 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c req-d19a47c8-4c69-4ea4-97c9-7d9e13644483 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0740051 Jan 05 15:03:51.004641 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-73e3ee06-9ec7-4bf0-9fd9-85b32106757c req-21b1f7e0-49e7-4e96-aa93-40182c59f428 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0763173 Jan 05 15:03:51.581317 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48254) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:51.639306 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b32954bc-cf91-48c4-b446-e17ae6aebaf1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:51.651910 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-5b728b33-2229-435b-95b7-9e8e15b72b60 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:51.653515 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-5b728b33-2229-435b-95b7-9e8e15b72b60 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0554953 Jan 05 15:03:51.665185 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b32954bc-cf91-48c4-b446-e17ae6aebaf1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:51.750599 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Deleting port 45483c3c-9f42-4aff-a962-22ff36647afc {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:03:51.751186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:51.769282 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b32954bc-cf91-48c4-b446-e17ae6aebaf1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:51.771986 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b32954bc-cf91-48c4-b446-e17ae6aebaf1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:51.773237 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-b32954bc-cf91-48c4-b446-e17ae6aebaf1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /v2.0/security-groups/552b70d6-a366-4dff-9b66-b1679ffedd08 HTTP/1.1" status: 204 len: 168 time: 0.1908991 Jan 05 15:03:51.776511 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48256) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:51.789498 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32954bc-cf91-48c4-b446-e17ae6aebaf1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=552b70d6-a366-4dff-9b66-b1679ffedd08,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:51.796424 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.api.v2.resource [None req-950ff899-2ece-45c1-ba9e-206c7983df5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] show failed (client error): The resource could not be found. Jan 05 15:03:51.798197 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-950ff899-2ece-45c1-ba9e-206c7983df5b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups/552b70d6-a366-4dff-9b66-b1679ffedd08 HTTP/1.1" status: 404 len: 347 time: 0.0195227 Jan 05 15:03:51.801088 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48258) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:52.003619 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Deleting port 398afa2a-6e6d-493b-b78c-fc2dedf65aab {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:03:52.004347 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.092322 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.092548 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.118242 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] For port 45483c3c-9f42-4aff-a962-22ff36647afc, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45483c3c-9f42-4aff-a962-22ff36647afc,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:52.125669 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.125817 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling delete_port for 398afa2a-6e6d-493b-b78c-fc2dedf65aab owned by network:floatingip {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:03:52.134553 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 req-37a4fd51-edc0-4e78-958e-496c022db688 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:52.136201 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 req-37a4fd51-edc0-4e78-958e-496c022db688 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0882435 Jan 05 15:03:52.147763 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7a825c-c000-4f68-8349-21044f25fc07 req-67e6a18c-5271-4f8b-ac78-037b1123b197 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:52.149342 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fe7a825c-c000-4f68-8349-21044f25fc07 req-67e6a18c-5271-4f8b-ac78-037b1123b197 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 947 time: 0.0745089 Jan 05 15:03:52.256155 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fe7a825c-c000-4f68-8349-21044f25fc07 req-73a95882-f778-491d-897d-004c630c90df tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=f3335da6-9782-4236-8228-e5257a8ab1ba&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0659437 Jan 05 15:03:52.279841 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a6a6cd5c-21b3-4cd8-9743-45e82f4b2034 req-11ecc8bc-6ba2-406c-87b0-e73a9bddc6c2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1266136 Jan 05 15:03:52.437757 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.439728 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.439728 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.439728 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Floating IP 7c474e8a-c72f-413b-9e04-47dc9cef12cc disassociated. External IP: 172.37.2.180, port: 45483c3c-9f42-4aff-a962-22ff36647afc. Jan 05 15:03:52.440103 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling delete_port for 45483c3c-9f42-4aff-a962-22ff36647afc owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:03:52.469382 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event deleted for resources: {'Port': ['ID=398afa2a-6e6d-493b-b78c-fc2dedf65aab,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:52.534068 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.537620 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.541458 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5cf01d44-035c-4620-bc01-79830d2c1e69 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /v2.0/floatingips/6c329830-7016-424d-a758-395eb597052f HTTP/1.1" status: 204 len: 168 time: 0.7360528 Jan 05 15:03:52.697125 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:52.729451 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event deleted for resources: {'Port': ['ID=45483c3c-9f42-4aff-a962-22ff36647afc,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:52.842297 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Router 9ec87e52-56d6-4808-9eb4-61d2fe146230 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:03:52.928856 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48280) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:52.934942 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-ffabe7bd-4d56-4d1d-8ef2-0e2271a75cea tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'security_group': {'name': 'tempest-securitygroup--68262674', 'description': 'tempest-description--1279774551'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:52.951858 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:03:52.961860 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] Sync routers for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:03:52.971954 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:52.972596 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:52.994902 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] No DVR routers for this DVR port 45483c3c-9f42-4aff-a962-22ff36647afc on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:03:52.997348 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.000726 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-25c1329d-4419-4cf2-82d4-3cdccdda9dbb req-0453a479-c667-4d96-8eff-a61c6e6b090f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "DELETE /v2.0/ports/45483c3c-9f42-4aff-a962-22ff36647afc HTTP/1.1" status: 204 len: 173 time: 1.3418696 Jan 05 15:03:53.001133 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-deleted', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:03:53.003387 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aed5b3ea-35bf-4e85-a10a-f83122c3df7b" -d '{"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-deleted", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:03:53.040140 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:03:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32fd9e08-46b8-452d-bf39-469100591ffc x-openstack-request-id: req-32fd9e08-46b8-452d-bf39-469100591ffc {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:03:53.040434 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1569cae4-ef52-4c04-9aa6-c8d4b45e6f75", "name": "network-vif-deleted", "tag": "45483c3c-9f42-4aff-a962-22ff36647afc", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:03:53.040686 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-32fd9e08-46b8-452d-bf39-469100591ffc {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:03:53.041128 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1569cae4-ef52-4c04-9aa6-c8d4b45e6f75', 'name': 'network-vif-deleted', 'tag': '45483c3c-9f42-4aff-a962-22ff36647afc', 'status': 'completed', 'code': 200} Jan 05 15:03:53.045623 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ffabe7bd-4d56-4d1d-8ef2-0e2271a75cea tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.079769 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:53.116144 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ffabe7bd-4d56-4d1d-8ef2-0e2271a75cea tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.293173 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:53.323990 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] Checking router: 9ec87e52-56d6-4808-9eb4-61d2fe146230 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:03:53.332722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:03:53.333327 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:03:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:53.361619 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-34c8b7ad-e01e-4f29-b066-fa59cbb90b34 req-fa410de0-b06c-45b2-9173-d08355d5de19 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0270932 Jan 05 15:03:53.389779 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ffabe7bd-4d56-4d1d-8ef2-0e2271a75cea tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.407041 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 req-cfcc27cc-99a3-43be-aa46-681e02fc1194 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:53.408990 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 req-cfcc27cc-99a3-43be-aa46-681e02fc1194 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0673070 Jan 05 15:03:53.429653 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffabe7bd-4d56-4d1d-8ef2-0e2271a75cea tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c199b6c6-b8e5-4563-8702-fc7592cfef5d,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:53.494370 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ffabe7bd-4d56-4d1d-8ef2-0e2271a75cea tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.494370 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-ffabe7bd-4d56-4d1d-8ef2-0e2271a75cea tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.5641484 Jan 05 15:03:53.495373 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f38e39b2-aac9-48fa-8a29-4f6c1edf3d20 req-f19439ba-f4d5-442f-8295-2a9920bdc0ea tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0794246 Jan 05 15:03:53.501390 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48288) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:53.509563 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-a394c109-fdfa-4a7a-95ae-67e340f61be5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'security_group_rule': {'security_group_id': 'c199b6c6-b8e5-4563-8702-fc7592cfef5d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:53.517704 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:03:53.541156 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 45483c3c-9f42-4aff-a962-22ff36647afc {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:03:53.541499 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 45483c3c-9f42-4aff-a962-22ff36647afc not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:03:53.541912 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 2886de19-8aa3-470c-a593-9381bdb36ca0 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:03:53.628460 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 2886de19-8aa3-470c-a593-9381bdb36ca0 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:03:53.628460 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 2886de19-8aa3-470c-a593-9381bdb36ca0 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:03:53.628460 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:03:53.729137 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a394c109-fdfa-4a7a-95ae-67e340f61be5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.799353 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a394c109-fdfa-4a7a-95ae-67e340f61be5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.832499 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:03:53.858806 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-675c4969-ba22-4e39-ba10-611d7baef165 None None] The sync data for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi is: [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:03:53.894447 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a394c109-fdfa-4a7a-95ae-67e340f61be5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.911846 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a394c109-fdfa-4a7a-95ae-67e340f61be5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8a49ca94-d31c-4ec3-b93f-a3ec349f76da,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:53.964896 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a394c109-fdfa-4a7a-95ae-67e340f61be5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:53.966222 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a394c109-fdfa-4a7a-95ae-67e340f61be5 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4637239 Jan 05 15:03:53.968779 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48302) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:53.973322 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-09b03d47-8d5d-4ef2-b4be-eaea17daf3d7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'security_group_rule': {'security_group_id': 'c199b6c6-b8e5-4563-8702-fc7592cfef5d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:54.087297 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a434b55a-0854-4fe4-b358-2fda4bd19f2b None None] New status for floating IP 7c474e8a-c72f-413b-9e04-47dc9cef12cc: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:03:54.273203 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-09b03d47-8d5d-4ef2-b4be-eaea17daf3d7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.329466 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-09b03d47-8d5d-4ef2-b4be-eaea17daf3d7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.371070 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48306) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:54.481646 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4b8b36ea-b67f-4720-b352-dcd0dd9c53f7 req-c79cf67c-3859-488b-8e50-3ef78b537680 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=1569cae4-ef52-4c04-9aa6-c8d4b45e6f75 HTTP/1.1" status: 200 len: 210 time: 0.0325327 Jan 05 15:03:54.493567 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-09b03d47-8d5d-4ef2-b4be-eaea17daf3d7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.512070 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15619ecf-4927-42b7-8ab9-fca3fc139baf admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.525830 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09b03d47-8d5d-4ef2-b4be-eaea17daf3d7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1215a5a4-c62c-4139-a28f-25c1840f6534,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:54.612568 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15619ecf-4927-42b7-8ab9-fca3fc139baf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.614521 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634f9e8f-7b63-4e0d-99de-bf3e6463123c req-f3cc1118-b1b3-42c3-a81d-7d8e2a7a42e1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:54.616003 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-634f9e8f-7b63-4e0d-99de-bf3e6463123c req-f3cc1118-b1b3-42c3-a81d-7d8e2a7a42e1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0491607 Jan 05 15:03:54.659544 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-09b03d47-8d5d-4ef2-b4be-eaea17daf3d7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.660912 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-09b03d47-8d5d-4ef2-b4be-eaea17daf3d7 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6911747 Jan 05 15:03:54.663932 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48314) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:54.669142 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:54.669690 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-634f9e8f-7b63-4e0d-99de-bf3e6463123c req-15313938-3728-4d5e-85bd-026930c37f81 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474336 Jan 05 15:03:54.692394 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15619ecf-4927-42b7-8ab9-fca3fc139baf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.734702 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-15619ecf-4927-42b7-8ab9-fca3fc139baf admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=afde703eb736423c9b831087ebd120b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3625491 Jan 05 15:03:54.735899 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15619ecf-4927-42b7-8ab9-fca3fc139baf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=173a5c12-0ede-4850-b7a8-081b145a0f3e,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:54.737312 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48316) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:54.782992 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.785190 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0ebd36c0-b5b9-4824-bd04-18f7719fde8e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.806583 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0ebd36c0-b5b9-4824-bd04-18f7719fde8e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.881934 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.925338 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0ebd36c0-b5b9-4824-bd04-18f7719fde8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.927966 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0ebd36c0-b5b9-4824-bd04-18f7719fde8e admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:54.929156 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0ebd36c0-b5b9-4824-bd04-18f7719fde8e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/173a5c12-0ede-4850-b7a8-081b145a0f3e HTTP/1.1" status: 204 len: 168 time: 0.1908512 Jan 05 15:03:54.936764 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebd36c0-b5b9-4824-bd04-18f7719fde8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=173a5c12-0ede-4850-b7a8-081b145a0f3e,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:55.026878 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Allocated IP 172.37.2.22 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/2895ea2e-220b-449b-a9a4-a92d89c7a6b0) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:55.126919 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.291664 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.331810 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:55.334657 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:55.337300 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:55.371325 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'Port': ['ID=2895ea2e-220b-449b-a9a4-a92d89c7a6b0,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:55.430028 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.529935 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.653846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48334) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:55.667616 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48336) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:55.668355 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d1a5e4d1-0c4d-48a1-93fc-d7d863b5c3cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.711391 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.740264 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f417cac-e772-466c-a58f-56a6d6f0c540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.749236 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d1a5e4d1-0c4d-48a1-93fc-d7d863b5c3cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.789091 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f417cac-e772-466c-a58f-56a6d6f0c540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.802708 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.825917 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d1a5e4d1-0c4d-48a1-93fc-d7d863b5c3cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.844726 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eca551e-628b-40eb-ac8b-58bc7a87b48f req-14584c83-dfe2-496e-bc96-7912241043bf tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:55.846243 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3eca551e-628b-40eb-ac8b-58bc7a87b48f req-14584c83-dfe2-496e-bc96-7912241043bf tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.1080918 Jan 05 15:03:55.868469 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d1a5e4d1-0c4d-48a1-93fc-d7d863b5c3cc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9ae7f2fddb8e440ca72925dcf89512db&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2132514 Jan 05 15:03:55.869629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a5e4d1-0c4d-48a1-93fc-d7d863b5c3cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0f32b65-2e91-4f72-83d9-5c3d6fadd44d,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:55.871877 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48342) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:55.919591 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'Port': ['ID=2895ea2e-220b-449b-a9a4-a92d89c7a6b0,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:55.922614 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-74256439-9b1e-4ea6-89e3-59351e685ce4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.938814 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.945860 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-74256439-9b1e-4ea6-89e3-59351e685ce4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:55.963151 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3eca551e-628b-40eb-ac8b-58bc7a87b48f req-7779efc2-b2ce-4e4c-9f88-b0e78ac0c54c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0784795 Jan 05 15:03:56.010990 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f417cac-e772-466c-a58f-56a6d6f0c540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.013630 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f417cac-e772-466c-a58f-56a6d6f0c540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.014791 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2f417cac-e772-466c-a58f-56a6d6f0c540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /v2.0/security-groups/f3335da6-9782-4236-8228-e5257a8ab1ba HTTP/1.1" status: 204 len: 168 time: 0.3461375 Jan 05 15:03:56.018106 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48344) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:56.024256 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f417cac-e772-466c-a58f-56a6d6f0c540 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3335da6-9782-4236-8228-e5257a8ab1ba,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:56.033414 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.api.v2.resource [None req-d2918a14-0076-411b-a6c1-a94415550ba2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] show failed (client error): The resource could not be found. Jan 05 15:03:56.034472 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d2918a14-0076-411b-a6c1-a94415550ba2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups/f3335da6-9782-4236-8228-e5257a8ab1ba HTTP/1.1" status: 404 len: 347 time: 0.0153267 Jan 05 15:03:56.037357 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48346) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:56.041761 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.043300 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-bb7a3358-832b-4a61-9c9a-4069beea3fda tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.3783305 Jan 05 15:03:56.113763 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-74256439-9b1e-4ea6-89e3-59351e685ce4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.116354 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-74256439-9b1e-4ea6-89e3-59351e685ce4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.117526 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-74256439-9b1e-4ea6-89e3-59351e685ce4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c0f32b65-2e91-4f72-83d9-5c3d6fadd44d HTTP/1.1" status: 204 len: 168 time: 0.2447431 Jan 05 15:03:56.139514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74256439-9b1e-4ea6-89e3-59351e685ce4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0f32b65-2e91-4f72-83d9-5c3d6fadd44d,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:56.178363 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Deleting port 8c032186-94a7-4a52-9b24-bccd5b79baa5 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:03:56.178711 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.292815 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.293172 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.315021 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-e48660e5-fbc6-47a3-9b18-18ff2d8e4478 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--68262674&fields=id&tenant_id=715006ffd8ba4e5b963511ec759ae152 HTTP/1.1" status: 200 len: 267 time: 0.0724788 Jan 05 15:03:56.315885 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling delete_port for 8c032186-94a7-4a52-9b24-bccd5b79baa5 owned by network:floatingip {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:03:56.487351 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-a7194e47-a858-4367-b1cb-69c8521968f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:56.489456 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-a7194e47-a858-4367-b1cb-69c8521968f4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 810 time: 0.1639044 Jan 05 15:03:56.513372 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-12b49e0a-5723-4178-92be-b72016d8105e tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/quotas/715006ffd8ba4e5b963511ec759ae152 HTTP/1.1" status: 200 len: 375 time: 0.0114985 Jan 05 15:03:56.597798 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-ce403665-4b6b-4d7d-a084-b986b7ff0968 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0611737 Jan 05 15:03:56.637807 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48370) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:56.655552 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.689463 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event deleted for resources: {'Port': ['ID=8c032186-94a7-4a52-9b24-bccd5b79baa5,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:56.760239 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d25c6304-0278-486b-89aa-d30c08ea800b admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.772369 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-3edb16bf-5f8a-4676-af63-fa2e3eb37f02 service neutron] 10.222.0.30 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1627593 Jan 05 15:03:56.795155 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.798363 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.802714 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-60278424-ff27-41a8-8e8d-659117f8394f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /v2.0/floatingips/7c474e8a-c72f-413b-9e04-47dc9cef12cc HTTP/1.1" status: 204 len: 168 time: 0.7612514 Jan 05 15:03:56.817648 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48374) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:56.837326 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fa9d2cb0-7153-45c8-bde7-009c6b90b156 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.873754 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d25c6304-0278-486b-89aa-d30c08ea800b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.881147 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-c0d55445-8db1-42a1-a816-dade47396777 service neutron] 10.222.0.30 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1043246 Jan 05 15:03:56.942100 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fa9d2cb0-7153-45c8-bde7-009c6b90b156 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:56.991262 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d25c6304-0278-486b-89aa-d30c08ea800b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.023558 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fa9d2cb0-7153-45c8-bde7-009c6b90b156 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.037418 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d25c6304-0278-486b-89aa-d30c08ea800b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=38366a8d0fe7487480ec8ce2f34e68bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3985116 Jan 05 15:03:57.039713 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d25c6304-0278-486b-89aa-d30c08ea800b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c79c47a-f388-47bd-8a4e-11ec65594cf7,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:57.040240 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48380) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:57.063352 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-fa9d2cb0-7153-45c8-bde7-009c6b90b156 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=384017be1a854c4c88477b8dc0c93840&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2444015 Jan 05 15:03:57.066325 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48382) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:57.086535 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa9d2cb0-7153-45c8-bde7-009c6b90b156 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91b279b4-b6ce-4cee-97ab-b7a0be88e9aa,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:57.093001 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2c13c199-d131-4918-9be0-4fa4cd4613f0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.134426 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-47a65520-ca56-4a42-ba9b-850a53951c6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.139398 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2c13c199-d131-4918-9be0-4fa4cd4613f0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.174221 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-47a65520-ca56-4a42-ba9b-850a53951c6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.209862 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48388) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:57.214286 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-4fb0dc1c-c0e8-4ee3-838f-201114f31759 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1433805968', 'description': 'tempest-description--846498'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:57.237997 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af req-b65a8481-f428-4017-9c9b-5efc92234f2e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:57.240163 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af req-b65a8481-f428-4017-9c9b-5efc92234f2e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0584733 Jan 05 15:03:57.286589 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b3825864-8d0c-4f67-bc4d-c0051d55bbc3 req-38ab35dd-2a87-40e3-a294-9f34e8f9dafb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 210 time: 0.0307906 Jan 05 15:03:57.310334 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2a0b0387-b53b-4bce-9eb0-96ecdcf1b7af req-8c3c0f81-d67f-43fd-b0d6-1f42de408a1b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563159 Jan 05 15:03:57.371215 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2c13c199-d131-4918-9be0-4fa4cd4613f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.374121 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2c13c199-d131-4918-9be0-4fa4cd4613f0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.375836 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2c13c199-d131-4918-9be0-4fa4cd4613f0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4c79c47a-f388-47bd-8a4e-11ec65594cf7 HTTP/1.1" status: 204 len: 168 time: 0.3345659 Jan 05 15:03:57.383712 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c13c199-d131-4918-9be0-4fa4cd4613f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c79c47a-f388-47bd-8a4e-11ec65594cf7,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:57.399863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4fb0dc1c-c0e8-4ee3-838f-201114f31759 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.402806 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-47a65520-ca56-4a42-ba9b-850a53951c6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.405370 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-47a65520-ca56-4a42-ba9b-850a53951c6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.406498 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-47a65520-ca56-4a42-ba9b-850a53951c6a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/91b279b4-b6ce-4cee-97ab-b7a0be88e9aa HTTP/1.1" status: 204 len: 168 time: 0.3392887 Jan 05 15:03:57.426758 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a65520-ca56-4a42-ba9b-850a53951c6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91b279b4-b6ce-4cee-97ab-b7a0be88e9aa,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:57.503962 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4fb0dc1c-c0e8-4ee3-838f-201114f31759 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.582457 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4fb0dc1c-c0e8-4ee3-838f-201114f31759 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.611616 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb0dc1c-c0e8-4ee3-838f-201114f31759 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e6bd0ca2-838f-4153-9be5-bb78f57bc543,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:57.659154 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4fb0dc1c-c0e8-4ee3-838f-201114f31759 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.660430 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4fb0dc1c-c0e8-4ee3-838f-201114f31759 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1793 time: 0.4496114 Jan 05 15:03:57.663278 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48400) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:57.667905 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-c60a2062-4172-4a52-a868-d904cd6dbe5c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'security_group_rule': {'security_group_id': 'e6bd0ca2-838f-4153-9be5-bb78f57bc543', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:57.763731 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c60a2062-4172-4a52-a868-d904cd6dbe5c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.819580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c60a2062-4172-4a52-a868-d904cd6dbe5c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.935558 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c60a2062-4172-4a52-a868-d904cd6dbe5c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:57.960514 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60a2062-4172-4a52-a868-d904cd6dbe5c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5f147d18-de5e-464b-bc08-b43bd7821d26,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:58.115864 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c60a2062-4172-4a52-a868-d904cd6dbe5c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.117285 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c60a2062-4172-4a52-a868-d904cd6dbe5c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4528766 Jan 05 15:03:58.122028 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48410) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:58.124379 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-c33d1798-0410-4547-9f6b-5775944f84a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'security_group_rule': {'security_group_id': 'e6bd0ca2-838f-4153-9be5-bb78f57bc543', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:58.170919 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-483b2792-256e-46b6-b24b-6cf94a79d3aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.254231 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c33d1798-0410-4547-9f6b-5775944f84a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.316242 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c33d1798-0410-4547-9f6b-5775944f84a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.397252 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0a52c34a-2979-45bb-b4ea-541377fed690 req-edd9cb0a-f35d-4635-91e8-94d431ff9475 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 210 time: 0.0326793 Jan 05 15:03:58.434219 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c33d1798-0410-4547-9f6b-5775944f84a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.438688 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bad97ae-6e03-4945-b1cd-93d05d565696 req-26521e31-fcbe-468e-a8b3-33a2cff507c6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:58.440256 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9bad97ae-6e03-4945-b1cd-93d05d565696 req-26521e31-fcbe-468e-a8b3-33a2cff507c6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0589046 Jan 05 15:03:58.453577 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33d1798-0410-4547-9f6b-5775944f84a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2566ba72-c60a-444d-8ed8-7a287e84757e,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:58.495093 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9bad97ae-6e03-4945-b1cd-93d05d565696 req-141ec66d-b976-4aa4-8c78-d93ff887f9e6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490282 Jan 05 15:03:58.544381 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c33d1798-0410-4547-9f6b-5775944f84a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.545637 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c33d1798-0410-4547-9f6b-5775944f84a4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4248340 Jan 05 15:03:58.554312 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48426) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:03:58.559092 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:58.650997 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.750086 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:58.856326 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Allocated IP 172.37.2.143 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/167d982f-a790-4e3d-bc88-28a8fdd587a5) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:03:58.962323 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.072191 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.109875 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:03:59.114271 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:03:59.121214 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:03:59.123184 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'Port': ['ID=167d982f-a790-4e3d-bc88-28a8fdd587a5,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:59.222128 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.342291 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.508541 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b7c14da5-847f-4d0d-9e0e-5c9ad34c581c details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:03:59.533552 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-33e21447-2917-42ea-93ea-b71aba28bd74 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:59.535626 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-33e21447-2917-42ea-93ea-b71aba28bd74 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 810 time: 0.1318176 Jan 05 15:03:59.558987 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-43299269-99fe-4d09-9326-18ea86814f0f req-42dc321f-ed98-4893-8f10-6917c0488854 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 210 time: 0.0541580 Jan 05 15:03:59.583013 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.629537 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:59.646307 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'port_id': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'mac_address': 'fa:16:3e:0c:2c:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 129, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:03:59.656552 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-c587537f-8705-41d1-9808-a0d38dafc9c4 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=715006ffd8ba4e5b963511ec759ae152 HTTP/1.1" status: 200 len: 378 time: 0.1074200 Jan 05 15:03:59.671677 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368137c0-c522-438d-9d86-20f56127c334 req-4091eecf-3652-4b0e-bf4c-e4dba6e7de06 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:03:59.673705 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-368137c0-c522-438d-9d86-20f56127c334 req-4091eecf-3652-4b0e-bf4c-e4dba6e7de06 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0958173 Jan 05 15:03:59.676617 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'port': {'device_id': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'admin_state_up': True, 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'security_groups': ['c199b6c6-b8e5-4563-8702-fc7592cfef5d']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:03:59.692374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.704232 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.706002 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b7c14da5-847f-4d0d-9e0e-5c9ad34c581c {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:03:59.727624 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:03:59.777457 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'Port': ['ID=167d982f-a790-4e3d-bc88-28a8fdd587a5,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:59.786002 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.793565 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-368137c0-c522-438d-9d86-20f56127c334 req-76e2f107-b59e-46e2-b694-cf14f320d642 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1108603 Jan 05 15:03:59.811619 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.864566 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:03:59.865203 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:03:59.866604 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-04d29e39-4676-44bc-97e1-ae12be27d48d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.3113289 Jan 05 15:03:59.872772 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.877197 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.878085 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:03:59.954275 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Made reservation on behalf of 715006ffd8ba4e5b963511ec759ae152 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:03:59.958075 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:00.087578 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-606dcca5-9d5f-4393-95f0-b33055bb1ad5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1433805968&fields=id&tenant_id=f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 267 time: 0.0433471 Jan 05 15:04:00.098532 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Allocated IP 172.20.0.12 (fb7bcda7-5039-4d82-bf68-12c9acc8a744/fd51f09d-6379-4a7e-97a4-fafd6cf55180/370464b7-853e-4daf-92d9-8ffcbe014202) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:04:00.117000 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:04:00.213597 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-3772ac31-1f44-4f84-955d-575d6237618d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:00.215287 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-3772ac31-1f44-4f84-955d-575d6237618d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 817 time: 0.1191456 Jan 05 15:04:00.233127 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-202f05b8-1c8f-44ca-bd62-75a1d9c4c5b9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/quotas/f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 375 time: 0.0117218 Jan 05 15:04:00.256706 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:00.287850 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-fd5d8bfd-5212-49a9-8f87-fdd7059c5804 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0489283 Jan 05 15:04:00.387569 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-8da8d61a-dab5-4939-b5b7-0db462dffdd0 service neutron] 10.222.0.30 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885131 Jan 05 15:04:00.443968 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:00.473839 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fe40b785-acd4-43b7-81bd-d88f95687dcd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:00.493810 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:04:00.493810 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:04:00.496880 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:04:00.533523 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event updated for resources: {'Port': ['ID=370464b7-853e-4daf-92d9-8ffcbe014202,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:00.570082 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:00.570766 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:00.673136 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 req-f79df8bc-2fc0-44b2-b953-14d6480d1cd1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:00.674673 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 req-f79df8bc-2fc0-44b2-b953-14d6480d1cd1 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 932 time: 0.0530283 Jan 05 15:04:00.716731 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-128159c5-9d2b-49e4-8fd0-d6d74532c112 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0546105 Jan 05 15:04:00.737204 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-ca30aed7-e5eb-4487-9b04-5508d7c91a71 service neutron] 10.222.0.30 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3430331 Jan 05 15:04:00.749103 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Request body: {'port': {'device_id': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:00.757433 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0ea09a4c-7ece-4433-b7dc-c7ceab813bf4 req-13216914-6810-439e-8019-3d6de00f4f5d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0747240 Jan 05 15:04:00.813010 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-7d64078d-e2ce-470f-b8f0-1ca5b2701814 None None] Provisioning complete for port 370464b7-853e-4daf-92d9-8ffcbe014202 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:04:00.813010 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-7d64078d-e2ce-470f-b8f0-1ca5b2701814 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:00.816002 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:00.875334 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-7d64078d-e2ce-470f-b8f0-1ca5b2701814 None None] Port 370464b7-853e-4daf-92d9-8ffcbe014202 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:04:01.034503 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 req-0d674d39-b89e-4ea1-a595-30729f2a2dd6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:01.035979 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 req-0d674d39-b89e-4ea1-a595-30729f2a2dd6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 944 time: 0.1153038 Jan 05 15:04:01.043032 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-99b51ef8-2f2b-4aa7-bb2f-10c0960af540 req-3c2065ff-393c-419c-9bc3-150b3110d2e1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 210 time: 0.0257828 Jan 05 15:04:01.121176 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bd0eaee6-f7e5-4054-920b-d4ca6b4e1ac4 req-ffba75ca-bff0-452d-8dd5-e84188a97235 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769503 Jan 05 15:04:01.173116 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 370464b7-853e-4daf-92d9-8ffcbe014202 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:04:01.180662 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.192531 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Transition to ACTIVE for port object 370464b7-853e-4daf-92d9-8ffcbe014202 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:04:01.296720 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.388366 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Pushing event updated for resources: {'Port': ['ID=370464b7-853e-4daf-92d9-8ffcbe014202,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:01.427801 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Attempting to bind port 370464b7-853e-4daf-92d9-8ffcbe014202 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:04:01.428491 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Attempting to bind port 370464b7-853e-4daf-92d9-8ffcbe014202 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:04:01.428491 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Attempting to bind port 370464b7-853e-4daf-92d9-8ffcbe014202 on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:04:01.434523 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Port 370464b7-853e-4daf-92d9-8ffcbe014202 on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:04:01.434858 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Attempting to bind port 370464b7-853e-4daf-92d9-8ffcbe014202 on network fb7bcda7-5039-4d82-bf68-12c9acc8a744 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:04:01.439870 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 3, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:04:01.440212 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Checking segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:04:01.440600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Bound using segment: {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:04:01.441141 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Bound port: 370464b7-853e-4daf-92d9-8ffcbe014202, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '07f0d075-8e78-40da-9903-e50c29fe982c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:04:01.441444 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.454809 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48510) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:01.508694 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b7c14da5-847f-4d0d-9e0e-5c9ad34c581c up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:04:01.531452 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] For port 370464b7-853e-4daf-92d9-8ffcbe014202, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:04:01.535453 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] For port 370464b7-853e-4daf-92d9-8ffcbe014202, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=370464b7-853e-4daf-92d9-8ffcbe014202,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:04:01.577049 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-77efc26c-b3a1-4aa4-bf76-883c22396468 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.600008 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.622266 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:04:01.627509 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:04:01.628558 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.635540 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:01.636073 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.637539 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] 10.222.0.13 "PUT /v2.0/ports/370464b7-853e-4daf-92d9-8ffcbe014202 HTTP/1.1" status: 200 len: 1094 time: 0.9056966 Jan 05 15:04:01.637985 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:01.640247 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-533ec0bf-9090-4435-9541-ab28b5b4c755" -d '{"events": [{"name": "network-changed", "server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:01.663445 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8294d633-d350-4b73-bd6a-db1f52f2afe7 service neutron] Pushing event updated for resources: {'Port': ['ID=370464b7-853e-4daf-92d9-8ffcbe014202,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:01.678222 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-77efc26c-b3a1-4aa4-bf76-883c22396468 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.704236 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2fcec89d-028a-4982-ae52-e5fc772d1bfa x-openstack-request-id: req-2fcec89d-028a-4982-ae52-e5fc772d1bfa {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:01.704530 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:01.704781 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2fcec89d-028a-4982-ae52-e5fc772d1bfa {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:01.705207 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202', 'status': 'completed', 'code': 200} Jan 05 15:04:01.728245 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.750153 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-77efc26c-b3a1-4aa4-bf76-883c22396468 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.762593 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:01.764416 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bb0219b-ec7a-462b-8530-24cd6c727921" -d '{"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-plugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:01.778170 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:04:01.806825 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-77efc26c-b3a1-4aa4-bf76-883c22396468 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=017b5da3f4084be79e0ae2a899dfff0f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3483658 Jan 05 15:04:01.806825 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77efc26c-b3a1-4aa4-bf76-883c22396468 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=622d7f56-8e5f-4b15-ae80-8546c3dd6faf,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:01.809541 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48522) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:01.842644 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 x-openstack-request-id: req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:01.843205 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-plugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:01.843205 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e206ac1a-dc1f-4c09-9f21-e194958ab2d8 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:01.843650 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'code': 200} Jan 05 15:04:01.844800 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.859988 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-226cdfec-2eba-42c8-8880-c35726227906 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:01.861545 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-226cdfec-2eba-42c8-8880-c35726227906 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 1097 time: 0.1138554 Jan 05 15:04:01.866391 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.901476 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-22bb0333-41d9-4f8a-bb11-b47ebefaee10 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:01.936348 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b173aa-2a99-444c-ab7a-fe936c62357a req-7de2e354-9c02-488c-8ab2-138b140aee41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:01.937878 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-24b173aa-2a99-444c-ab7a-fe936c62357a req-7de2e354-9c02-488c-8ab2-138b140aee41 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 944 time: 0.0746145 Jan 05 15:04:01.947973 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:01.971592 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-22bb0333-41d9-4f8a-bb11-b47ebefaee10 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:02.006064 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-24b173aa-2a99-444c-ab7a-fe936c62357a req-0b3dcb8c-7506-4caa-99a1-4901d683d485 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0611849 Jan 05 15:04:02.030937 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-b3bb30a9-6b3f-4853-b75c-64e5961c84c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:02.032388 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-b3bb30a9-6b3f-4853-b75c-64e5961c84c0 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=715006ffd8ba4e5b963511ec759ae152&shared=False HTTP/1.1" status: 200 len: 911 time: 0.1477551 Jan 05 15:04:02.152675 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9bb68460-f204-4de7-9b22-f3e83e8c167d req-98c49196-931f-45af-af84-5b78b2a9eb43 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 210 time: 0.0342264 Jan 05 15:04:02.153690 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-62e803e3-29ae-4830-b940-c61041b4d0fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:02.154985 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-533ec0bf-9090-4435-9541-ab28b5b4c755 req-62e803e3-29ae-4830-b940-c61041b4d0fb service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1156745 Jan 05 15:04:02.159300 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-22bb0333-41d9-4f8a-bb11-b47ebefaee10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:02.167233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-22bb0333-41d9-4f8a-bb11-b47ebefaee10 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:02.167233 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-22bb0333-41d9-4f8a-bb11-b47ebefaee10 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/622d7f56-8e5f-4b15-ae80-8546c3dd6faf HTTP/1.1" status: 204 len: 168 time: 0.3432229 Jan 05 15:04:02.171265 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22bb0333-41d9-4f8a-bb11-b47ebefaee10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=622d7f56-8e5f-4b15-ae80-8546c3dd6faf,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:02.271205 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-6091bfb1-16fa-4f83-8044-52ad92e91c10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:02.274119 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-6091bfb1-16fa-4f83-8044-52ad92e91c10 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 1097 time: 0.0498548 Jan 05 15:04:02.287307 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba011ae-b9da-460d-874d-150d42f63ee1 req-12cf813a-1651-4ca4-b7ac-b487a3989ed1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:02.288855 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cba011ae-b9da-460d-874d-150d42f63ee1 req-12cf813a-1651-4ca4-b7ac-b487a3989ed1 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0493252 Jan 05 15:04:02.326321 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8ddf608b-36fb-4696-ad33-7fc5554262f6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=370464b7-853e-4daf-92d9-8ffcbe014202 HTTP/1.1" status: 200 len: 217 time: 0.0392036 Jan 05 15:04:02.344156 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cba011ae-b9da-460d-874d-150d42f63ee1 req-007c1518-3d29-4df8-bd4d-d6f039434f47 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489328 Jan 05 15:04:02.405666 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-87003c21-b3cd-485f-a17a-c8977a63da44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:02.409007 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-87003c21-b3cd-485f-a17a-c8977a63da44 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 200 len: 849 time: 0.0735104 Jan 05 15:04:02.413465 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8a53fa-c275-4a28-85aa-0763ca6e4d1d req-f9822d6d-40d5-4b1d-9933-5019b18cc94d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:02.414870 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ad8a53fa-c275-4a28-85aa-0763ca6e4d1d req-f9822d6d-40d5-4b1d-9933-5019b18cc94d service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1098 time: 0.0519428 Jan 05 15:04:02.487355 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ad8a53fa-c275-4a28-85aa-0763ca6e4d1d req-fc30ae3d-e101-459e-8626-bcb6e9ffb7dc service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0635872 Jan 05 15:04:02.489834 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8ad71edc-3759-48b4-be38-dfdc640b100f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:02.491232 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-8ad71edc-3759-48b4-be38-dfdc640b100f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fb7bcda7-5039-4d82-bf68-12c9acc8a744&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0754952 Jan 05 15:04:02.757308 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:02.835866 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-f86b1de5-26da-45ad-9655-7877041eb5f8 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812314 Jan 05 15:04:02.923640 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48532) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:02.942174 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5b02ee17-7244-41fa-b63a-6315fbec9eed admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.021980 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5b02ee17-7244-41fa-b63a-6315fbec9eed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.158902 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5b02ee17-7244-41fa-b63a-6315fbec9eed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.202778 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5b02ee17-7244-41fa-b63a-6315fbec9eed admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=53474641f2ef4ebaaa331d3912f280ed&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2756166 Jan 05 15:04:03.202778 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b02ee17-7244-41fa-b63a-6315fbec9eed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09b8b3ef-9c1e-4d66-966a-465a8b558185,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:03.207794 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48538) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:03.217824 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9ed08650-ae76-4189-8cf3-e608c4d27d4f req-a6a484b4-5aeb-4dc3-a20c-541835a7c685 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3761392 Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.224950 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:03.227315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a req-8f376e93-4f52-4f03-86de-042166164538 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:03.228098 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a req-8f376e93-4f52-4f03-86de-042166164538 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 944 time: 0.0816762 Jan 05 15:04:03.285860 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-85a1abbc-9422-46b3-99b3-c10b5ff5a95a req-97ea7a10-a882-4e06-89f2-89870b3002fb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0492914 Jan 05 15:04:03.288510 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fbabb0bc-c14a-4109-a12d-9cb995a21830 req-d58edf46-e344-4eeb-95d7-41b106798a0a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 210 time: 0.0351505 Jan 05 15:04:03.291720 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2a7e3ca0-c989-4917-9f5c-c9e0be72369b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.320885 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2a7e3ca0-c989-4917-9f5c-c9e0be72369b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.462143 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0435410b-2c0c-4919-a477-5e0f4dc779c1 req-73288784-a3bc-4c2c-b359-890943dd7f45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:03.462143 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0435410b-2c0c-4919-a477-5e0f4dc779c1 req-73288784-a3bc-4c2c-b359-890943dd7f45 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0512266 Jan 05 15:04:03.497527 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2a7e3ca0-c989-4917-9f5c-c9e0be72369b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.500312 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2a7e3ca0-c989-4917-9f5c-c9e0be72369b admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.501496 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2a7e3ca0-c989-4917-9f5c-c9e0be72369b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/09b8b3ef-9c1e-4d66-966a-465a8b558185 HTTP/1.1" status: 204 len: 168 time: 0.2942975 Jan 05 15:04:03.517734 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0435410b-2c0c-4919-a477-5e0f4dc779c1 req-aa7e328d-0267-4349-90e8-8253ce93151e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496528 Jan 05 15:04:03.519373 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a7e3ca0-c989-4917-9f5c-c9e0be72369b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09b8b3ef-9c1e-4d66-966a-465a8b558185,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:03.520730 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:03.663015 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-aaa55ca4-da92-4d64-b364-d8244c934dab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:03.664534 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-aaa55ca4-da92-4d64-b364-d8244c934dab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 817 time: 0.1144950 Jan 05 15:04:03.734315 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-9407bffb-be51-4504-bc32-072e59692718 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 380 time: 0.0522411 Jan 05 15:04:03.751521 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'port': {'device_id': 'a591f495-ff59-4865-87ea-c48041ea097f', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'admin_state_up': True, 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'security_groups': ['e6bd0ca2-838f-4153-9be5-bb78f57bc543']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:03.959515 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Made reservation on behalf of f4a45a70c5d046238abaad07fbe529e9 for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:04:03.963699 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:04.095660 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Allocated IP 172.20.0.3 (1c375b41-1339-4d14-93e7-e473aa7e6978/afd427f5-19eb-439b-9825-d3ec4a285d49/0d57813b-5531-41c7-8d8d-8b2fc393b843) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:04:04.229998 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:04.372199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:04.423880 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a6fcf5-7b57-4593-9494-50fde3db8182 req-d5604488-1313-4c48-8cf8-02373718dd6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:04.427364 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-75a6fcf5-7b57-4593-9494-50fde3db8182 req-d5604488-1313-4c48-8cf8-02373718dd6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 944 time: 0.0634143 Jan 05 15:04:04.431560 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:04:04.445336 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:04.453122 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:04:04.456638 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:04:04.459206 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:04.481550 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-75a6fcf5-7b57-4593-9494-50fde3db8182 req-3a546fd5-b152-4a4b-8802-f011120176eb tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0486128 Jan 05 15:04:04.516954 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:04.517801 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:04.543784 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5767f19e-1eb6-438f-96a1-e9aa4338d815 req-7403f0dd-dc45-42ff-9a4a-1aff9cbcfd83 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:04.545354 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5767f19e-1eb6-438f-96a1-e9aa4338d815 req-7403f0dd-dc45-42ff-9a4a-1aff9cbcfd83 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 931 time: 0.1434875 Jan 05 15:04:04.604596 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-f184e1a8-3417-4e57-a8d3-74306d84dae8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8566890 Jan 05 15:04:04.627650 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5767f19e-1eb6-438f-96a1-e9aa4338d815 req-f15b55ec-dd54-48b3-b520-e9194c576f68 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0747366 Jan 05 15:04:04.640005 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Request body: {'port': {'device_id': 'a591f495-ff59-4865-87ea-c48041ea097f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:04.697387 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d req-d2a7cc96-64bc-4cc6-8a01-1561b8db66c8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:04.698914 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d req-d2a7cc96-64bc-4cc6-8a01-1561b8db66c8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0638449 Jan 05 15:04:04.711154 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:04.751864 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f39cd517-2a81-40ce-98c0-cd012f2b3e6d req-aabe0eec-6b34-44b3-87c2-a704089df30e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448339 Jan 05 15:04:04.798853 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-ff3ec9f3-3f29-40e6-a9f8-8c7a74ce6b5a None None] Provisioning complete for port 0d57813b-5531-41c7-8d8d-8b2fc393b843 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:04:04.799334 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ff3ec9f3-3f29-40e6-a9f8-8c7a74ce6b5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:04.838057 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48574) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:04.847227 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-ff3ec9f3-3f29-40e6-a9f8-8c7a74ce6b5a None None] Port 0d57813b-5531-41c7-8d8d-8b2fc393b843 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:04:04.935256 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-687604030-network', 'tenant_id': 'a7a76dae13c24b43b6094f0aa8cfb6d3'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:04.952158 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 req-0521e4e9-2285-4662-925e-289b99ccb9e5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:04.954604 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 req-0521e4e9-2285-4662-925e-289b99ccb9e5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.1063156 Jan 05 15:04:05.045183 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Made reservation on behalf of a7a76dae13c24b43b6094f0aa8cfb6d3 for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:04:05.048665 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.054341 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-43bf5c71-2db0-4b0a-941c-db6d37ec8117 req-b281c0d7-8d48-47b7-88d2-5ab86607b10c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0882502 Jan 05 15:04:05.057480 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.068537 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d57813b-5531-41c7-8d8d-8b2fc393b843 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:04:05.076381 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.078389 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48578) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:05.093500 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Transition to ACTIVE for port object 0d57813b-5531-41c7-8d8d-8b2fc393b843 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:04:05.138584 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.182637 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.228195 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.262531 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:05.276758 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 117} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:04:05.284834 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e29201b-7653-4628-9068-ca907c7f0e28,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:05.296248 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.296837 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Added segment 9ccdca5b-063a-4027-83ac-1e6adf9bdc1a of type vlan for network 756972eb-a72f-4bb1-8df2-39ad73705a2b Jan 05 15:04:05.331033 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a96aced-64aa-42f6-bc63-99effe1d1905 tempest-TestShelveInstance-1948212084 tempest-TestShelveInstance-1948212084-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:05.332564 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0a96aced-64aa-42f6-bc63-99effe1d1905 tempest-TestShelveInstance-1948212084 tempest-TestShelveInstance-1948212084-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1093 time: 0.2532353 Jan 05 15:04:05.336987 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48582) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:05.341461 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'port_id': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'fixed_ip_address': '172.20.0.4'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:05.369514 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.375400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Attempting to bind port 0d57813b-5531-41c7-8d8d-8b2fc393b843 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:04:05.375400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Attempting to bind port 0d57813b-5531-41c7-8d8d-8b2fc393b843 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:04:05.375400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Attempting to bind port 0d57813b-5531-41c7-8d8d-8b2fc393b843 on network 1c375b41-1339-4d14-93e7-e473aa7e6978 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:04:05.381533 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Port 0d57813b-5531-41c7-8d8d-8b2fc393b843 on network 1c375b41-1339-4d14-93e7-e473aa7e6978 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:04:05.381859 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Attempting to bind port 0d57813b-5531-41c7-8d8d-8b2fc393b843 on network 1c375b41-1339-4d14-93e7-e473aa7e6978 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:04:05.387595 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 4, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:04:05.388299 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Checking segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:04:05.389464 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Bound using segment: {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:04:05.390017 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Bound port: 0d57813b-5531-41c7-8d8d-8b2fc393b843, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6c95c843-d01b-4253-a6ef-82805037a6f7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:04:05.391225 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.457437 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:04:05.459588 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for floatingip, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.463003 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:04:05.488947 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.489945 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:05.490575 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.550093 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] Pushing event updated for resources: {'Network': ['ID=756972eb-a72f-4bb1-8df2-39ad73705a2b,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:05.552306 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.563985 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 756972eb-a72f-4bb1-8df2-39ad73705a2b details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:04:05.573271 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4ac5329f-1c78-41ad-9a6f-cbc1c1bdd9b1 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7338226 Jan 05 15:04:05.586274 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48586) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:05.595750 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Request body: {'subnet': {'network_id': '756972eb-a72f-4bb1-8df2-39ad73705a2b', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-687604030-subnet', 'tenant_id': 'a7a76dae13c24b43b6094f0aa8cfb6d3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:05.602070 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:05.602750 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.604565 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] 10.222.0.13 "PUT /v2.0/ports/0d57813b-5531-41c7-8d8d-8b2fc393b843 HTTP/1.1" status: 200 len: 1093 time: 0.9737391 Jan 05 15:04:05.606245 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:05.611820 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b9c6ddb-979c-4a60-9194-854b93de194c" -d '{"events": [{"name": "network-changed", "server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:05.627631 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.696580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 req-6d933518-a846-4398-85f2-407504adeb13 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:05.706323 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 req-6d933518-a846-4398-85f2-407504adeb13 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 944 time: 0.1315351 Jan 05 15:04:05.731468 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Made reservation on behalf of a7a76dae13c24b43b6094f0aa8cfb6d3 for: {'subnet': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:04:05.733816 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4267422'] for subnet, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:05.755799 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Allocated IP 172.37.2.221 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/243d8473-2700-4d07-9b49-de450e7a88cf) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:04:05.760009 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-621c34e2-9086-4b94-805b-3d72dee67fea x-openstack-request-id: req-621c34e2-9086-4b94-805b-3d72dee67fea {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:05.760210 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:05.760493 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-621c34e2-9086-4b94-805b-3d72dee67fea {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:05.762113 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'status': 'completed', 'code': 200} Jan 05 15:04:05.812840 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ba692ed2-5a43-4f3b-af81-8f5136d4a403 req-630a90a8-4510-4dbd-9b78-e1d56cd6ef49 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1046302 Jan 05 15:04:05.831014 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-833e3160-8297-443f-bbf6-d55e71c86c56 service neutron] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:05.918467 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-6ee7aa4c-a270-4bd9-abe9-5f620bfad25d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:05.920087 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-6ee7aa4c-a270-4bd9-abe9-5f620bfad25d service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1096 time: 0.1619306 Jan 05 15:04:05.930224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-161eeba7-9e8a-4770-a25b-00573a759dcc req-757d8774-ed07-49fe-a893-4764625622f6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:05.936879 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-161eeba7-9e8a-4770-a25b-00573a759dcc req-757d8774-ed07-49fe-a893-4764625622f6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.1691070 Jan 05 15:04:06.011289 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4701419', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4267372'] for subnet, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:06.051795 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:06.065869 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Pushing event updated for resources: {'Subnet': ['ID=38273cc5-9e86-4b10-bff4-d42f6cce4147,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:06.075377 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Checking segment: {'id': '9ccdca5b-063a-4027-83ac-1e6adf9bdc1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': '756972eb-a72f-4bb1-8df2-39ad73705a2b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:04:06.075744 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Network hostable DHCP agents. Network: 756972eb-a72f-4bb1-8df2-39ad73705a2b, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114655) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:04:06.085535 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-161eeba7-9e8a-4770-a25b-00573a759dcc req-41cbb6e0-f224-4841-b038-2c1e46b0dd40 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1471245 Jan 05 15:04:06.120374 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-e14763a2-261c-4406-8e44-9c440e8532e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.121876 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-e14763a2-261c-4406-8e44-9c440e8532e2 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=f4a45a70c5d046238abaad07fbe529e9&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1824086 Jan 05 15:04:06.221681 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-2acc1b95-81aa-48d1-b51d-90774bde7cb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.223154 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6b9c6ddb-979c-4a60-9194-854b93de194c req-2acc1b95-81aa-48d1-b51d-90774bde7cb6 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0952730 Jan 05 15:04:06.245330 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Network 756972eb-a72f-4bb1-8df2-39ad73705a2b is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114655) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:04:06.252727 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:06.327910 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:04:06.338347 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:04:06.348963 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df44e316-0e39-4391-88d4-eaa5b9235dc8 req-cb25b30f-34a8-498d-9620-405340cffbdd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.351861 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-df44e316-0e39-4391-88d4-eaa5b9235dc8 req-cb25b30f-34a8-498d-9620-405340cffbdd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.1313107 Jan 05 15:04:06.351861 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:04:06.353535 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'Port': ['ID=243d8473-2700-4d07-9b49-de450e7a88cf,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:06.374844 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 756972eb-a72f-4bb1-8df2-39ad73705a2b) {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:04:06.380387 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.381778 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:06.382946 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b6a65c0-9422-45f7-9e92-acc39987e0ee None None] Network 756972eb-a72f-4bb1-8df2-39ad73705a2b requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:04:06.443784 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-319018c8-2766-4efc-b585-0f625acaff61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.445375 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-319018c8-2766-4efc-b585-0f625acaff61 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1096 time: 0.1543162 Jan 05 15:04:06.482022 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f59eab89-d43e-4552-9e33-1660b75684fd None None] Network 756972eb-a72f-4bb1-8df2-39ad73705a2b requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:04:06.482187 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9e5fdc3e-6dae-4240-b718-128bb63c099c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8924801 Jan 05 15:04:06.484546 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-fe8c3e18-2855-4c43-9e10-04b8e6bc8684 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.486117 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-fe8c3e18-2855-4c43-9e10-04b8e6bc8684 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1138 time: 0.1287212 Jan 05 15:04:06.549580 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-c1c6fe4e-831e-41c8-a1e1-b6733ab159ee service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843 HTTP/1.1" status: 200 len: 217 time: 0.0896103 Jan 05 15:04:06.582391 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-df44e316-0e39-4391-88d4-eaa5b9235dc8 req-064652c7-a323-4943-973f-4f1bb1855c30 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2238750 Jan 05 15:04:06.735864 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-eb219030-45a2-4084-be9c-76ea42f9fa31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.737365 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-eb219030-45a2-4084-be9c-76ea42f9fa31 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.1738310 Jan 05 15:04:06.781510 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-1aca6627-2668-4209-b04b-e4d896a743a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.782971 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-1aca6627-2668-4209-b04b-e4d896a743a8 service neutron] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 915 time: 0.2546828 Jan 05 15:04:06.888165 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-6be629cb-0d7a-4666-a8df-883ff920f292 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.889678 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-6be629cb-0d7a-4666-a8df-883ff920f292 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1430225 Jan 05 15:04:06.928255 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f req-b5b5e46c-7089-490f-98ab-642e27d20743 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:06.929770 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f req-b5b5e46c-7089-490f-98ab-642e27d20743 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 944 time: 0.0485699 Jan 05 15:04:06.987234 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6292f976-5e59-4ce1-81e3-a6a14dad5a4f req-8175fa1c-720e-4c76-af4a-ed50fe478638 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0501022 Jan 05 15:04:07.217921 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-5b20be53-1c1e-40e1-9905-b5e61c2e8c37 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 1001 time: 0.4273934 Jan 05 15:04:07.283739 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48616) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:07.288520 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1340932974-network', 'tenant_id': '60e4d6b05c2e44879f4e5920fddb4e06'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:07.410847 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Made reservation on behalf of 60e4d6b05c2e44879f4e5920fddb4e06 for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:04:07.413254 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.421821 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.425355 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-0d7cdf3d-85ab-4750-a408-857890fb8b3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:07.426822 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-0d7cdf3d-85ab-4750-a408-857890fb8b3b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.2000751 Jan 05 15:04:07.444868 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24fb26f-252c-4672-90f1-c07893964871 req-2db46b2a-a2fc-498f-b94a-08c4af0e2fce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:07.446314 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e24fb26f-252c-4672-90f1-c07893964871 req-2db46b2a-a2fc-498f-b94a-08c4af0e2fce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.2307308 Jan 05 15:04:07.480520 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-24568ef5-0978-4658-a095-5e13ad0a7896 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5829165 Jan 05 15:04:07.496861 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.539262 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 370464b7-853e-4daf-92d9-8ffcbe014202 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:04:07.587862 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.611022 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 118} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:04:07.625141 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.630496 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d8d2fcc-4ae5-4f04-9b61-069f1923d57e,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:07.636088 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.636437 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Added segment 9a4ed6f1-1849-4414-8883-2d391125e541 of type vlan for network 201436e7-dce9-4ffe-8c8d-3f457744d9f2 Jan 05 15:04:07.655278 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e24fb26f-252c-4672-90f1-c07893964871 req-9257c372-876a-4499-9cdd-773b67a90eaa tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1712768 Jan 05 15:04:07.657086 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-0fe0d81f-dc6e-438b-98fc-e42e0f17b9dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:07.658510 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-0fe0d81f-dc6e-438b-98fc-e42e0f17b9dd service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2217681 Jan 05 15:04:07.670587 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 370464b7-853e-4daf-92d9-8ffcbe014202, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=370464b7-853e-4daf-92d9-8ffcbe014202,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:04:07.686280 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '370464b7-853e-4daf-92d9-8ffcbe014202', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'port_id': '370464b7-853e-4daf-92d9-8ffcbe014202', 'mac_address': 'fa:16:3e:8f:fc:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:04:07.710814 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fae8e9d0-d7c1-40f9-b2ca-00dde941d476 req-903b8ccd-2f56-4b7a-aa2e-78ed5bcd6d78 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2233429 Jan 05 15:04:07.730433 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.736210 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.745786 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 370464b7-853e-4daf-92d9-8ffcbe014202 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:04:07.773119 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 370464b7-853e-4daf-92d9-8ffcbe014202, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=370464b7-853e-4daf-92d9-8ffcbe014202,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:04:07.779327 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce req-09585d16-4839-4f84-929e-547832677272 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:07.781851 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce req-09585d16-4839-4f84-929e-547832677272 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0875223 Jan 05 15:04:07.784777 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-1d7d4464-5991-4bd4-932f-efa249c679b6 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1162865 Jan 05 15:04:07.843252 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8f0f2f20-adc6-4a72-bcb8-e5e51e7801ce req-35a07647-c611-4d09-a12a-ba400be1c043 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0556712 Jan 05 15:04:07.856675 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.857256 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.857680 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:07.858287 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.903980 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:07.907354 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73a25c90-93f4-447b-9ee5-f236bb475a82 req-6805c4e0-9d14-427d-8243-32efe0d4a426 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1164193 Jan 05 15:04:07.909407 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=370464b7-853e-4daf-92d9-8ffcbe014202,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:07.923729 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] Pushing event updated for resources: {'Network': ['ID=201436e7-dce9-4ffe-8c8d-3f457744d9f2,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:07.936363 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 201436e7-dce9-4ffe-8c8d-3f457744d9f2 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:04:07.952066 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c89f088f-42ff-413c-827b-9cf1b5169c06 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6672180 Jan 05 15:04:07.955237 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48620) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:07.968227 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Request body: {'subnet': {'network_id': '201436e7-dce9-4ffe-8c8d-3f457744d9f2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1340932974-subnet', 'tenant_id': '60e4d6b05c2e44879f4e5920fddb4e06', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:08.106315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:08.122993 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83901938-a1d5-4803-826e-48d3f02051fc req-5fe6aed2-8f98-40a3-8a40-03792ecba1a2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:08.124493 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-83901938-a1d5-4803-826e-48d3f02051fc req-5fe6aed2-8f98-40a3-8a40-03792ecba1a2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 945 time: 0.0658131 Jan 05 15:04:08.136669 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Made reservation on behalf of 60e4d6b05c2e44879f4e5920fddb4e06 for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:04:08.138891 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8833947'] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:08.178202 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['370464b7-853e-4daf-92d9-8ffcbe014202'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:04:08.219510 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:08.266031 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-83901938-a1d5-4803-826e-48d3f02051fc req-81e1dcf2-70be-4faa-99a1-2a5cfc82fe6b tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1353042 Jan 05 15:04:08.313826 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event updated for resources: {'Port': ['ID=243d8473-2700-4d07-9b49-de450e7a88cf,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:08.335095 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:08.490762 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Floating IP 9cdb696f-0e62-4bcf-ab96-e4f6f26366b4 associated. External IP: 172.37.2.221, port: b7c14da5-847f-4d0d-9e0e-5c9ad34c581c. Jan 05 15:04:08.571572 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8855778', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8833897'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:08.688272 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6ad0992f-63b5-4885-a15e-11c45598d755,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:08.699529 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Checking segment: {'id': '9a4ed6f1-1849-4414-8883-2d391125e541', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '201436e7-dce9-4ffe-8c8d-3f457744d9f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:04:08.699877 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Network hostable DHCP agents. Network: 201436e7-dce9-4ffe-8c8d-3f457744d9f2, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:04:08.772209 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Router b38ee346-0c33-4eb4-8342-134f3f715196 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:04:08.787456 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 req-e45ea1e9-0aef-48e9-b2b9-b742d91a6754 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:08.789243 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 req-e45ea1e9-0aef-48e9-b2b9-b742d91a6754 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0490031 Jan 05 15:04:08.821755 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Network 201436e7-dce9-4ffe-8c8d-3f457744d9f2 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:04:08.841005 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f63c06fd-c9b0-4741-bffb-469d0e1eeb05 req-59a71570-4693-4875-9d31-f18dadd5ec10 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459929 Jan 05 15:04:08.881438 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:04:08.891844 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] Sync routers for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:04:08.906260 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:04:08.906885 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:04:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:08.920914 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 201436e7-dce9-4ffe-8c8d-3f457744d9f2) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:04:08.943378 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:08.943987 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:08.950594 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bc9a53c-bc1f-4087-8ce4-2ceb0fc9ab2d None None] Network 201436e7-dce9-4ffe-8c8d-3f457744d9f2 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:04:08.979821 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b req-f552609c-bbbd-44a2-b48d-23b6685186b1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:08.981567 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b req-f552609c-bbbd-44a2-b48d-23b6685186b1 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0703247 Jan 05 15:04:09.011054 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:09.059311 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c27d6c00-d81c-4b9f-a3b0-53cdef8df973 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.1028419 Jan 05 15:04:09.065122 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-ce77c195-a961-455f-91ec-af97afc2e744 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.7270672 Jan 05 15:04:09.071357 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:09.083350 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624" -d '{"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:09.113512 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ab6cfde7-e1d2-483b-a0d4-dc9efabf0b2b req-e9cf77ba-8255-4890-a786-67b1dfbe329f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1218762 Jan 05 15:04:09.132290 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c2f05a0-5152-4365-8ece-fe3e694ff530 x-openstack-request-id: req-0c2f05a0-5152-4365-8ece-fe3e694ff530 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:09.132290 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:09.133205 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0c2f05a0-5152-4365-8ece-fe3e694ff530 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:09.133739 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'status': 'completed', 'code': 200} Jan 05 15:04:09.211824 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:04:09.223623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-2dd7a64c-9c53-4bca-87ea-d19fe03bfc21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:09.225239 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-2dd7a64c-9c53-4bca-87ea-d19fe03bfc21 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1098 time: 0.0446770 Jan 05 15:04:09.278679 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04ab542f-5b1b-4211-b4a9-264df6639713 None None] Network 201436e7-dce9-4ffe-8c8d-3f457744d9f2 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:04:09.341649 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-8ab22c01-e7fc-4ac5-88f8-61ea42a85689 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:09.343085 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-8ab22c01-e7fc-4ac5-88f8-61ea42a85689 service neutron] 10.222.0.13 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 909 time: 0.1076880 Jan 05 15:04:09.440292 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-ea26b589-95cb-445c-8dcb-aefcb2803ae1 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 999 time: 0.0901253 Jan 05 15:04:09.454254 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba req-01d060f3-e9a9-4796-bd88-4eb083558616 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:09.455216 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba req-01d060f3-e9a9-4796-bd88-4eb083558616 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 945 time: 0.0989654 Jan 05 15:04:09.521733 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-3a66a7a8-c3f7-4211-a3ca-390df8d03054 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:09.523198 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-3a66a7a8-c3f7-4211-a3ca-390df8d03054 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 200 len: 847 time: 0.0671124 Jan 05 15:04:09.549290 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1c4cf84a-1e1f-490b-ac51-4c6f9277aeba req-2c4f526c-ab1d-4eb1-84ee-07ba25073ecc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0679219 Jan 05 15:04:09.550751 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '9cdb696f-0e62-4bcf-ab96-e4f6f26366b4', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'floating_ip_address': '172.37.2.221', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'port_id': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 515, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'mac_address': 'fa:16:3e:0c:2c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:04:06Z', 'updated_at': '2022-01-05T15:04:06Z', 'revision_number': 0, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:06Z', 'revision_number': 5, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:09.555077 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 370464b7-853e-4daf-92d9-8ffcbe014202 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:04:09.585996 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-1e61e61a-2c37-4ae4-b48d-389eb347af69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:09.587549 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-1e61e61a-2c37-4ae4-b48d-389eb347af69 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=e5205e82-a517-4157-848a-78560d0d2806&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0585022 Jan 05 15:04:09.599943 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] Checking router: b38ee346-0c33-4eb4-8342-134f3f715196 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:04:09.620412 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:04:09.620412 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:04:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:09.685144 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-d7be05d2-1a29-444b-a255-bf12feecd50a service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902405 Jan 05 15:04:09.732109 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:04:09.771121 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 370464b7-853e-4daf-92d9-8ffcbe014202 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:04:09.776667 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da31a1b5-104a-4ab1-9839-f7fdcd1ef624 req-9d9a8abb-156e-4fd2-916f-9a3651d7c398 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846448 Jan 05 15:04:09.806210 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 370464b7-853e-4daf-92d9-8ffcbe014202 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:04:09.806587 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:09.958022 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:09.961390 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 req-35bc0985-960a-4fa7-a86c-3b4052f14c54 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:09.962966 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 req-35bc0985-960a-4fa7-a86c-3b4052f14c54 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0489490 Jan 05 15:04:10.010844 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c3eda75a-888c-4091-bdfc-5dba9a8bb222 req-81b057db-da19-45fc-b368-9698e2e2e720 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421672 Jan 05 15:04:10.012499 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:10.014766 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be804c39-d192-434c-8055-9034d727d9ca" -d '{"events": [{"server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "name": "network-vif-plugged", "status": "completed", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:10.031184 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 370464b7-853e-4daf-92d9-8ffcbe014202, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=370464b7-853e-4daf-92d9-8ffcbe014202,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:04:10.056144 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '9cdb696f-0e62-4bcf-ab96-e4f6f26366b4', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'floating_ip_address': '172.37.2.221', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'port_id': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 515, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'mac_address': 'fa:16:3e:0c:2c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:04:06Z', 'updated_at': '2022-01-05T15:04:06Z', 'revision_number': 0, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:06Z', 'revision_number': 5, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:10.086757 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 x-openstack-request-id: req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:10.087056 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "name": "network-vif-plugged", "status": "completed", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:10.087313 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ce75d781-f220-4d8e-a290-4c45a20b1ff9 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:10.087710 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202', 'code': 200} Jan 05 15:04:10.088941 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffdcb89e-25ad-45a4-8f9c-fcf429d49375 None None] The sync data for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi is: [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '9cdb696f-0e62-4bcf-ab96-e4f6f26366b4', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'floating_ip_address': '172.37.2.221', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'port_id': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 515, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'mac_address': 'fa:16:3e:0c:2c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:04:06Z', 'updated_at': '2022-01-05T15:04:06Z', 'revision_number': 0, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:06Z', 'revision_number': 5, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:04:10.108569 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:10.164966 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=370464b7-853e-4daf-92d9-8ffcbe014202,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:10.251601 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 req-e62e6bcc-c0df-4997-8962-0892bcd499d3 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:10.253224 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 req-e62e6bcc-c0df-4997-8962-0892bcd499d3 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0524998 Jan 05 15:04:10.319833 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8174f83a-f3f6-4a89-b4dc-449c13b8af47 req-c4f9e979-6c3d-4370-a330-5a0b3b5411a8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0581486 Jan 05 15:04:10.322412 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef84fbba-8c8a-43e2-b48e-b75749eb0adb None None] New status for floating IP 9cdb696f-0e62-4bcf-ab96-e4f6f26366b4: ACTIVE {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:04:10.464357 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3543b37e-8bfb-49c9-9514-3acf6f49cd6f req-848ebb67-4cdb-4f31-987e-c862f61479f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:10.465784 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3543b37e-8bfb-49c9-9514-3acf6f49cd6f req-848ebb67-4cdb-4f31-987e-c862f61479f3 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 1099 time: 0.0394487 Jan 05 15:04:10.762353 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3543b37e-8bfb-49c9-9514-3acf6f49cd6f req-309b8a50-953d-42f4-9871-e06ce1374937 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2894726 Jan 05 15:04:10.797221 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c489398-9df7-4392-84d3-20fa21502c51 req-88fe3d58-02c7-4ac7-828e-c65e568db097 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:10.798663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0c489398-9df7-4392-84d3-20fa21502c51 req-88fe3d58-02c7-4ac7-828e-c65e568db097 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0490899 Jan 05 15:04:10.845190 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0c489398-9df7-4392-84d3-20fa21502c51 req-9399e2ba-f185-4691-95ab-dc86125a785d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0409961 Jan 05 15:04:11.137392 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90544d49-6d4a-41a5-8d9c-4a88888042ff req-bf084adc-2e8d-4cd9-a967-0cb7b8a936e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:11.139009 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-90544d49-6d4a-41a5-8d9c-4a88888042ff req-bf084adc-2e8d-4cd9-a967-0cb7b8a936e9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0530677 Jan 05 15:04:11.187174 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-90544d49-6d4a-41a5-8d9c-4a88888042ff req-ff8ad718-2268-453e-af03-0f71aa98efc7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411222 Jan 05 15:04:11.435990 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60987826-8778-4b72-b563-828183f49620 req-9b0572f6-d446-487a-b21f-d678a6b12d35 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:11.438022 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60987826-8778-4b72-b563-828183f49620 req-9b0572f6-d446-487a-b21f-d678a6b12d35 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0494792 Jan 05 15:04:11.496214 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60987826-8778-4b72-b563-828183f49620 req-15352ba9-4687-443b-abb7-4c4699519af3 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0524473 Jan 05 15:04:11.571528 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:04:11.674533 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:04:11.686030 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'port_id': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'mac_address': 'fa:16:3e:f0:40:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:04:11.722657 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:11.737088 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d57813b-5531-41c7-8d8d-8b2fc393b843 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:04:11.758057 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:04:11.848647 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:11.900816 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:11.960259 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 req-e18a9995-4899-416b-9caa-6ed22a51f83c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:11.961735 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 req-e18a9995-4899-416b-9caa-6ed22a51f83c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0483818 Jan 05 15:04:12.008584 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b44f1d26-fd88-43eb-9ce4-1cf7bcd8dca9 req-beb5d7dc-54da-4a2a-a0d9-531175080516 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0411248 Jan 05 15:04:12.192071 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['0d57813b-5531-41c7-8d8d-8b2fc393b843'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:04:12.310117 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9a73333-ccb2-465b-b4a0-cf227c759191 req-e8d602f0-5cf1-407b-ac24-56e9bc7728e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:12.311683 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a9a73333-ccb2-465b-b4a0-cf227c759191 req-e8d602f0-5cf1-407b-ac24-56e9bc7728e6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 944 time: 0.0525753 Jan 05 15:04:12.361629 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a9a73333-ccb2-465b-b4a0-cf227c759191 req-6a95510a-4c14-4234-abcf-a052f3641362 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437407 Jan 05 15:04:12.611353 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 req-1968e089-cf78-4727-b101-f2c83ac7af71 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:12.612813 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 req-1968e089-cf78-4727-b101-f2c83ac7af71 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0479102 Jan 05 15:04:12.681744 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f0a3f82b-430d-4909-8cc6-ea3fcd3b6a49 req-4c1e26bb-7a54-4f58-97de-8163f247f8c4 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0633402 Jan 05 15:04:13.119667 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01386ed3-bd97-45ce-bcf6-aec5eb32383e req-bf72bce9-ff16-4997-8225-cf0ac84cefcd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:13.121151 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-01386ed3-bd97-45ce-bcf6-aec5eb32383e req-bf72bce9-ff16-4997-8225-cf0ac84cefcd tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0477211 Jan 05 15:04:13.166908 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-01386ed3-bd97-45ce-bcf6-aec5eb32383e req-c684c763-26c9-472f-a0a3-768015caedb2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0397363 Jan 05 15:04:13.276729 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45b76e4-87c3-4430-af94-c263001f22f2 req-f8d87ce4-8f09-45d6-9993-034f5f6e982c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:13.278225 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b45b76e4-87c3-4430-af94-c263001f22f2 req-f8d87ce4-8f09-45d6-9993-034f5f6e982c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0483902 Jan 05 15:04:13.287038 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48684) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:13.291516 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Request body: {'floatingip': {'port_id': '370464b7-853e-4daf-92d9-8ffcbe014202'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:13.333678 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:13.526536 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fe5fef-33f1-4101-b25d-40ab54fd7797 req-8c3514fe-c23e-498e-bae7-3d6d4d969c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:13.528014 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-78fe5fef-33f1-4101-b25d-40ab54fd7797 req-8c3514fe-c23e-498e-bae7-3d6d4d969c47 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 944 time: 0.0934117 Jan 05 15:04:13.600823 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:04:13.652210 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-78fe5fef-33f1-4101-b25d-40ab54fd7797 req-a50b55cc-d520-40bd-9b12-00d97cad9890 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1183550 Jan 05 15:04:13.740176 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 0d57813b-5531-41c7-8d8d-8b2fc393b843 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:04:13.744149 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 0d57813b-5531-41c7-8d8d-8b2fc393b843 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:04:13.744517 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:13.797439 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202200d6-d50b-4cbf-92c1-34a360285e82 req-31b0fbd6-f653-4db4-8ca9-a0e86c1a0d6c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:13.798939 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-202200d6-d50b-4cbf-92c1-34a360285e82 req-31b0fbd6-f653-4db4-8ca9-a0e86c1a0d6c tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0505309 Jan 05 15:04:13.823151 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:13.845333 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:13.846577 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:13.848877 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d93db7a-ea8a-472f-bcbd-a84ae599a56c" -d '{"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:13.861838 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-202200d6-d50b-4cbf-92c1-34a360285e82 req-6e9ce9ce-26ac-4d9d-87e9-a8972bea7911 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0568023 Jan 05 15:04:13.862023 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:04:13.886938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 x-openstack-request-id: req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:13.887231 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:13.887511 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-61366f4f-1a0f-4cfd-b5b8-caeda01f8c44 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:13.887933 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'code': 200} Jan 05 15:04:13.900042 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:13.976664 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:14.005038 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Floating IP 25ce5b32-e110-4764-88ef-cf1aec671947 associated. External IP: 172.37.2.22, port: 370464b7-853e-4daf-92d9-8ffcbe014202. Jan 05 15:04:14.030284 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:14.235527 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Router d3c49f70-ad09-435c-bdeb-024562318429 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:04:14.242746 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db8db82-121a-47d7-9b85-aacec583075a req-9f1287e3-9caa-46f9-86c8-6d5a40fccd0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:14.244212 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3db8db82-121a-47d7-9b85-aacec583075a req-9f1287e3-9caa-46f9-86c8-6d5a40fccd0e service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1098 time: 0.0547347 Jan 05 15:04:14.334444 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3db8db82-121a-47d7-9b85-aacec583075a req-e7931e0d-0a89-43dd-8d6c-f6d5a2999d0a service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0812020 Jan 05 15:04:14.378881 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:04:14.383638 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:14.388181 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] Sync routers for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:04:14.401260 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:04:14.403270 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:04:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:14.432763 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b4a874f9-d7b0-4eb1-8b67-3e7a53bd565c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "PUT /v2.0/floatingips/25ce5b32-e110-4764-88ef-cf1aec671947 HTTP/1.1" status: 200 len: 991 time: 1.1347466 Jan 05 15:04:14.433629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:14.436418 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a4a17bf-acdd-4aa1-978a-a36665e50487" -d '{"events": [{"name": "network-changed", "server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:14.483065 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01fdbdf2-3a25-45ba-89db-05629e7e51db x-openstack-request-id: req-01fdbdf2-3a25-45ba-89db-05629e7e51db {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:14.483305 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:14.483565 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-01fdbdf2-3a25-45ba-89db-05629e7e51db {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:14.484589 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202', 'status': 'completed', 'code': 200} Jan 05 15:04:14.523989 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:04:14.728344 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-4b3c8b22-7057-4248-a7df-b25d8e139362 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:14.730369 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-4b3c8b22-7057-4248-a7df-b25d8e139362 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=715006ffd8ba4e5b963511ec759ae152&device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 1099 time: 0.0535321 Jan 05 15:04:14.758490 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '25ce5b32-e110-4764-88ef-cf1aec671947', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'floating_ip_address': '172.37.2.22', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'port_id': '370464b7-853e-4daf-92d9-8ffcbe014202', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 471, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'mac_address': 'fa:16:3e:8f:fc:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:55Z', 'updated_at': '2022-01-05T15:04:13Z', 'revision_number': 1, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:14.789900 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] Checking router: d3c49f70-ad09-435c-bdeb-024562318429 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:04:14.798056 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:04:14.798720 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:04:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:14.835883 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b455113d-f393-4153-8ede-245c50b46be7 req-09449e67-e8f4-416b-b34a-b08154820beb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:14.837507 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b455113d-f393-4153-8ede-245c50b46be7 req-09449e67-e8f4-416b-b34a-b08154820beb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.1056080 Jan 05 15:04:14.882955 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-6beaec89-f97e-4195-a629-7ced182e05e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:14.884460 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-6beaec89-f97e-4195-a629-7ced182e05e2 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 200 len: 911 time: 0.1426618 Jan 05 15:04:14.953608 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b455113d-f393-4153-8ede-245c50b46be7 req-57ca44d1-067d-4e7a-a524-3c5127b0ea0a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1040537 Jan 05 15:04:14.974317 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-5923d65d-3665-4280-b95a-99c5ce591c4e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=370464b7-853e-4daf-92d9-8ffcbe014202 HTTP/1.1" status: 200 len: 999 time: 0.0816596 Jan 05 15:04:14.994419 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3938334-0bea-4727-9056-585bc3994e47 req-c3575361-264d-4307-96ab-be20b077306d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:14.996033 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b3938334-0bea-4727-9056-585bc3994e47 req-c3575361-264d-4307-96ab-be20b077306d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0597105 Jan 05 15:04:15.027772 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-4bf8db66-c3bb-480a-a7ea-1b66e3e992ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:15.029300 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-4bf8db66-c3bb-480a-a7ea-1b66e3e992ad service neutron] 10.222.0.13 "GET /v2.0/subnets?id=fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 200 len: 849 time: 0.0487928 Jan 05 15:04:15.037282 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:04:15.061288 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b3938334-0bea-4727-9056-585bc3994e47 req-6c62b3ce-ef5b-4ab5-b986-3d783bdffadb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0574994 Jan 05 15:04:15.091629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-ff285c97-f8ba-4764-aaa2-7fcf36dffa1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:15.093775 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-ff285c97-f8ba-4764-aaa2-7fcf36dffa1f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fb7bcda7-5039-4d82-bf68-12c9acc8a744&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0493205 Jan 05 15:04:15.186570 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-6a04b2a3-c667-43a5-8cad-1bc900e743be service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863030 Jan 05 15:04:15.261588 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '25ce5b32-e110-4764-88ef-cf1aec671947', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'floating_ip_address': '172.37.2.22', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'port_id': '370464b7-853e-4daf-92d9-8ffcbe014202', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 471, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'mac_address': 'fa:16:3e:8f:fc:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:55Z', 'updated_at': '2022-01-05T15:04:13Z', 'revision_number': 1, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:15.279198 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6a4a17bf-acdd-4aa1-978a-a36665e50487 req-1c800f4b-9ad9-4cb0-bcd2-47662b879022 service neutron] 10.222.0.13 "GET /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831654 Jan 05 15:04:15.288054 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c19b01c-921d-4ed2-aa8a-73b71509fc0f None None] The sync data for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi is: [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '25ce5b32-e110-4764-88ef-cf1aec671947', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'floating_ip_address': '172.37.2.22', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'port_id': '370464b7-853e-4daf-92d9-8ffcbe014202', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 471, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'mac_address': 'fa:16:3e:8f:fc:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:55Z', 'updated_at': '2022-01-05T15:04:13Z', 'revision_number': 1, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:04:15.498805 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60c47228-1428-4f70-a4f8-2d7a28e42f53 None None] New status for floating IP 25ce5b32-e110-4764-88ef-cf1aec671947: ACTIVE {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:04:16.078164 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f3d135-d36a-4cac-9701-9fefa0502f55 req-9e5903ba-937e-49da-b196-7a545e040e0b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:16.079647 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-52f3d135-d36a-4cac-9701-9fefa0502f55 req-9e5903ba-937e-49da-b196-7a545e040e0b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0497885 Jan 05 15:04:16.128632 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-52f3d135-d36a-4cac-9701-9fefa0502f55 req-3dd9ca45-67d8-4f2b-86c5-6ca984d3c393 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432801 Jan 05 15:04:16.185203 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 req-7e88a244-8435-4a96-a565-30ace0b10a97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:16.186718 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 req-7e88a244-8435-4a96-a565-30ace0b10a97 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0546417 Jan 05 15:04:16.245004 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c963cb-47d2-4b6e-971c-778337c5f49f req-b9e9cceb-c9d5-49d8-91dc-62dfe43bd6d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:16.246485 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e2c963cb-47d2-4b6e-971c-778337c5f49f req-b9e9cceb-c9d5-49d8-91dc-62dfe43bd6d5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0492194 Jan 05 15:04:16.247398 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a23c8450-9ec6-4022-9dc5-7bc50484efc4 req-44c7c2cf-bcdf-4b5d-b62f-1b59bbca41e3 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0547726 Jan 05 15:04:16.255721 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48726) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:16.260279 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Request body: {'floatingip': {'port_id': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:04:16.302188 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:16.756687 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:16.839320 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:16.936710 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Floating IP 4359b184-17b1-47c9-80b1-fc623c80beca associated. External IP: 172.37.2.143, port: 0d57813b-5531-41c7-8d8d-8b2fc393b843. Jan 05 15:04:17.136221 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Router 9ec87e52-56d6-4808-9eb4-61d2fe146230 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:04:17.239588 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:04:17.244074 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:17.248909 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58ff38d1-de50-4272-af56-17d929099bab None None] Sync routers for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:04:17.263234 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:04:17.263907 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:04:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:17.271673 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-6ec102e0-e415-4569-88bf-e489db7c2881 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "PUT /v2.0/floatingips/4359b184-17b1-47c9-80b1-fc623c80beca HTTP/1.1" status: 200 len: 991 time: 1.0148292 Jan 05 15:04:17.272672 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:04:17.275155 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32201c29-107f-42f4-bc69-3c8b2d60ccaa" -d '{"events": [{"name": "network-changed", "server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:04:17.373522 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:04:17.377132 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a46d90-6f52-4972-80df-1e2470fb8441 req-5777280e-4c35-4822-869b-864cbbf0b71f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:17.378752 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-01a46d90-6f52-4972-80df-1e2470fb8441 req-5777280e-4c35-4822-869b-864cbbf0b71f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0511253 Jan 05 15:04:17.444635 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:04:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3183abee-f923-429e-a96d-33568913566c x-openstack-request-id: req-3183abee-f923-429e-a96d-33568913566c {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:04:17.445145 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:04:17.445553 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3183abee-f923-429e-a96d-33568913566c {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:04:17.446104 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'status': 'completed', 'code': 200} Jan 05 15:04:17.459548 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-01a46d90-6f52-4972-80df-1e2470fb8441 req-40523287-8132-47d8-bb7b-512474981173 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0749433 Jan 05 15:04:17.536628 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-5595b39a-7570-44cc-b934-22ad80f6e7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:17.538205 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-5595b39a-7570-44cc-b934-22ad80f6e7aa service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1098 time: 0.0467153 Jan 05 15:04:17.618993 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '4359b184-17b1-47c9-80b1-fc623c80beca', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'floating_ip_address': '172.37.2.143', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'port_id': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'mac_address': 'fa:16:3e:f0:40:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a591f495-ff59-4865-87ea-c48041ea097f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:59Z', 'updated_at': '2022-01-05T15:04:16Z', 'revision_number': 1, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:17.637004 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-dfd50d75-0374-4dfe-88a9-af156177ba27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:17.638421 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-dfd50d75-0374-4dfe-88a9-af156177ba27 service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.0928223 Jan 05 15:04:17.648517 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58ff38d1-de50-4272-af56-17d929099bab None None] Checking router: 9ec87e52-56d6-4808-9eb4-61d2fe146230 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:04:17.657427 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:04:17.658026 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:04:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:17.710625 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-0e82e4c6-7d86-47f9-9aaf-726afd265823 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843 HTTP/1.1" status: 200 len: 999 time: 0.0635149 Jan 05 15:04:17.768337 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:04:17.771283 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-bdbaa264-eaa7-40b6-9b7a-933f69335243 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:17.772764 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-bdbaa264-eaa7-40b6-9b7a-933f69335243 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0550833 Jan 05 15:04:17.818115 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-bbec334b-3db7-49b1-891e-cc6436674dbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:17.819848 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-bbec334b-3db7-49b1-891e-cc6436674dbe service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405679 Jan 05 15:04:17.920020 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-f0d67f6a-49c9-4cd7-afab-e3e80a055691 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861795 Jan 05 15:04:18.004480 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-58ff38d1-de50-4272-af56-17d929099bab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '4359b184-17b1-47c9-80b1-fc623c80beca', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'floating_ip_address': '172.37.2.143', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'port_id': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'mac_address': 'fa:16:3e:f0:40:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a591f495-ff59-4865-87ea-c48041ea097f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:59Z', 'updated_at': '2022-01-05T15:04:16Z', 'revision_number': 1, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:18.011603 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32201c29-107f-42f4-bc69-3c8b2d60ccaa req-a1dada23-12c8-44c2-8546-f86516184fc5 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850782 Jan 05 15:04:18.031283 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58ff38d1-de50-4272-af56-17d929099bab None None] The sync data for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi is: [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '4359b184-17b1-47c9-80b1-fc623c80beca', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'floating_ip_address': '172.37.2.143', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'port_id': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'mac_address': 'fa:16:3e:f0:40:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a591f495-ff59-4865-87ea-c48041ea097f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:03:59Z', 'updated_at': '2022-01-05T15:04:16Z', 'revision_number': 1, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:04:18.229334 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e04c43b5-a6bd-472e-924b-38611c994e6a None None] New status for floating IP 4359b184-17b1-47c9-80b1-fc623c80beca: ACTIVE {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:04:18.587585 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f89af6-acf9-4973-9a14-bcefb4484c4b req-93dcdbec-4d17-496d-9f42-9e53eefdf7c8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:18.589053 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c2f89af6-acf9-4973-9a14-bcefb4484c4b req-93dcdbec-4d17-496d-9f42-9e53eefdf7c8 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0492291 Jan 05 15:04:18.648348 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c2f89af6-acf9-4973-9a14-bcefb4484c4b req-eb701181-96e0-4393-aba9-f5b89ba48206 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0530617 Jan 05 15:04:19.768664 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbaf418-518d-40c0-87de-f2592ba557a6 req-00bbfe76-b6a3-41b6-b51e-c4b94e35bf6e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:19.770104 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8dbaf418-518d-40c0-87de-f2592ba557a6 req-00bbfe76-b6a3-41b6-b51e-c4b94e35bf6e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0525544 Jan 05 15:04:19.828879 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8dbaf418-518d-40c0-87de-f2592ba557a6 req-16db4d26-3550-4820-a2d5-ddeaba3b8d03 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0532029 Jan 05 15:04:20.944110 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e69e181a-a831-4a23-a3e9-42230b772af7 req-c1b5cb0c-0dea-4ba2-8594-c0bb86926769 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:20.945578 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e69e181a-a831-4a23-a3e9-42230b772af7 req-c1b5cb0c-0dea-4ba2-8594-c0bb86926769 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0482731 Jan 05 15:04:21.008562 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e69e181a-a831-4a23-a3e9-42230b772af7 req-04c616c9-9670-4226-9954-6a232672b1e5 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0575356 Jan 05 15:04:22.279057 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b88c1d-d8af-433c-86dd-edad9252ee4f req-bc29d562-fb00-44cc-9391-870d1f50c561 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:22.281166 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-04b88c1d-d8af-433c-86dd-edad9252ee4f req-bc29d562-fb00-44cc-9391-870d1f50c561 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.2016838 Jan 05 15:04:22.339834 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-04b88c1d-d8af-433c-86dd-edad9252ee4f req-8819fce0-6bc3-4bb8-98a3-e3545e55decd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0529833 Jan 05 15:04:22.967114 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:04:23.507940 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 req-c11c731b-68bb-4ab6-9d2e-f86f7396c2dd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:23.509428 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 req-c11c731b-68bb-4ab6-9d2e-f86f7396c2dd tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0971980 Jan 05 15:04:23.568581 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b0bfb302-28b0-4bae-9ed5-dbec6ccac0a6 req-937b6b84-f2a1-4599-9e53-b89a4c959b4a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525036 Jan 05 15:04:24.691685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c req-074aef22-cad4-4858-9032-6e77bab3b98d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:24.693246 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c req-074aef22-cad4-4858-9032-6e77bab3b98d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0494764 Jan 05 15:04:24.753763 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5162651-a5ac-4ea3-ae1d-cd321242ba1c req-6fc27c44-19f1-4ece-ac2a-973ab06f9939 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=2767f584-b06b-4dab-a69f-33162778019e&id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0548568 Jan 05 15:04:25.932135 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48858) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:25.977922 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] Deleting subnet 38273cc5-9e86-4b10-bff4-d42f6cce4147 {{(pid=114654) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:04:25.981272 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.015084 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8770652'] for subnet, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.052363 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.165231 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8855717', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8833888'] for subnet, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.191280 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=38273cc5-9e86-4b10-bff4-d42f6cce4147,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:26.196123 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.199591 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0d558e68-39af-4d73-b63c-489945e8eca3 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/38273cc5-9e86-4b10-bff4-d42f6cce4147 HTTP/1.1" status: 204 len: 168 time: 0.2662668 Jan 05 15:04:26.201861 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48860) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:26.275415 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.357841 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.380590 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['756972eb-a72f-4bb1-8df2-39ad73705a2b']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:26.392066 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ccdca5b-063a-4027-83ac-1e6adf9bdc1a') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:26.392361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ccdca5b-063a-4027-83ac-1e6adf9bdc1a') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:26.401932 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.415445 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.421878 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Releasing vlan 117 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:04:26.422274 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:04:26.423923 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:04:26.427733 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:04:26.563221 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.568098 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.571338 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] 10.222.0.30 "DELETE /v2.0/networks/756972eb-a72f-4bb1-8df2-39ad73705a2b HTTP/1.1" status: 204 len: 168 time: 0.3685772 Jan 05 15:04:26.574231 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48864) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:26.584218 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd788e6-77b1-4eaf-a2ac-5694b80d40d8 admin admin] Pushing event deleted for resources: {'Network': ['ID=756972eb-a72f-4bb1-8df2-39ad73705a2b,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:26.618361 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] Deleting subnet 6ad0992f-63b5-4885-a15e-11c45598d755 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:04:26.621489 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.654256 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:26.936121 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.080280 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.105655 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6ad0992f-63b5-4885-a15e-11c45598d755,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:27.109407 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.112589 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-15394ec2-0f8a-459a-b363-88c5737127e1 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/6ad0992f-63b5-4885-a15e-11c45598d755 HTTP/1.1" status: 204 len: 168 time: 0.5373278 Jan 05 15:04:27.115029 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48868) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:27.182331 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.256350 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.275717 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['201436e7-dce9-4ffe-8c8d-3f457744d9f2']}} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:27.284500 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a4ed6f1-1849-4414-8883-2d391125e541') {'for_net_delete': True} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:27.284787 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a4ed6f1-1849-4414-8883-2d391125e541') {} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:04:27.293687 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4701328'] for segment, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.306093 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.311658 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Releasing vlan 118 on physical network physnet1 to pool {{(pid=114655) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:04:27.312558 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4698958'] for segment, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: Traceback (most recent call last): Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: timer() Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: cb(*args, **kw) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: return func(*args, **kwargs) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: self._notify() Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: self.callback(batched_events) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: event.method(event) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: return f(self, *a, **k) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: return self._get(url).json() Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: return self.request(url, 'GET', **kwargs) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:04:27.314167 dv-cinder-master-3-iscsi neutron-server[114655]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:04:27.433497 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.441408 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.444575 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] 10.222.0.30 "DELETE /v2.0/networks/201436e7-dce9-4ffe-8c8d-3f457744d9f2 HTTP/1.1" status: 204 len: 168 time: 0.3286407 Jan 05 15:04:27.454691 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6b3db34-b779-426b-9bab-4cd849cdd78a admin admin] Pushing event deleted for resources: {'Network': ['ID=201436e7-dce9-4ffe-8c8d-3f457744d9f2,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:27.882918 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48874) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:27.920966 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-47b7ad7d-b4ea-46e4-8cdb-2a728087ae55 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a7a76dae13c24b43b6094f0aa8cfb6d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0369236 Jan 05 15:04:27.923948 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48876) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:27.969329 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fb5872d8-bd56-49af-bda6-908fa05f1e63 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:27.993323 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fb5872d8-bd56-49af-bda6-908fa05f1e63 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:28.193411 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fb5872d8-bd56-49af-bda6-908fa05f1e63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:28.196019 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fb5872d8-bd56-49af-bda6-908fa05f1e63 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:28.197212 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-fb5872d8-bd56-49af-bda6-908fa05f1e63 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9e29201b-7653-4628-9068-ca907c7f0e28 HTTP/1.1" status: 204 len: 168 time: 0.2723646 Jan 05 15:04:28.205484 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5872d8-bd56-49af-bda6-908fa05f1e63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e29201b-7653-4628-9068-ca907c7f0e28,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:28.236964 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-19704e1a-09cd-46ab-89fd-309b62d35a0a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:28.819968 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48886) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:28.861898 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c1503dff-f4bd-449c-88b2-0a0a1ab1d052 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=60e4d6b05c2e44879f4e5920fddb4e06&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0407937 Jan 05 15:04:28.864203 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48888) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:28.909351 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4bd79fae-71c8-4e44-bbf8-46fef8174192 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:28.929459 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4bd79fae-71c8-4e44-bbf8-46fef8174192 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:29.067630 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4bd79fae-71c8-4e44-bbf8-46fef8174192 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:29.070154 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4bd79fae-71c8-4e44-bbf8-46fef8174192 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:29.071297 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4bd79fae-71c8-4e44-bbf8-46fef8174192 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1d8d2fcc-4ae5-4f04-9b61-069f1923d57e HTTP/1.1" status: 204 len: 168 time: 0.2062283 Jan 05 15:04:29.079215 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd79fae-71c8-4e44-bbf8-46fef8174192 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d8d2fcc-4ae5-4f04-9b61-069f1923d57e,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:30.396613 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0d097e1c-0690-4d25-93aa-4f8d57457e59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:31.810570 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:32.745145 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:33.160057 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-012297d9-2f33-409e-80fa-6988c98ce22a service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0485375 Jan 05 15:04:33.279618 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20459f9-e837-474c-9363-4f79ce725d54 req-9657eba0-2320-4032-b52a-d000236b4052 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:33.281214 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-9657eba0-2320-4032-b52a-d000236b4052 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1138 time: 0.0404065 Jan 05 15:04:33.386904 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20459f9-e837-474c-9363-4f79ce725d54 req-fda7cebe-9f9a-44e4-8975-f422b2c670a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:33.388363 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-fda7cebe-9f9a-44e4-8975-f422b2c670a9 service neutron] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 915 time: 0.0856061 Jan 05 15:04:33.453683 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-c9a8c328-e2ec-46bb-96d4-86d63dd6a963 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 1001 time: 0.0576003 Jan 05 15:04:33.510839 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20459f9-e837-474c-9363-4f79ce725d54 req-78629635-238a-499c-b03d-b04ed2d3cd37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:33.512575 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-78629635-238a-499c-b03d-b04ed2d3cd37 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.0503519 Jan 05 15:04:33.559178 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:33.561458 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20459f9-e837-474c-9363-4f79ce725d54 req-a78db270-3e14-4715-87a6-7b76b03b36fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:04:33.563508 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-a78db270-3e14-4715-87a6-7b76b03b36fe service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0449798 Jan 05 15:04:33.655162 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-e3ac6928-e441-4f90-a54a-e29f218d8065 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816226 Jan 05 15:04:33.745862 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c20459f9-e837-474c-9363-4f79ce725d54 req-b8db9902-4955-4d99-b1a5-dd454bbf1493 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838675 Jan 05 15:04:34.422618 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.452154 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48968) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:34.555049 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.627672 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.710723 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.748991 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=fc318dd66557476c972f7d24d4304b22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2954798 Jan 05 15:04:34.749866 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2947e2d-ea21-4aca-8b28-18b38f47dc5b,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:34.751767 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48972) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:34.757049 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.757439 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.757784 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.758121 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.758511 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.758793 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.759125 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.759453 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.759780 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.760106 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.760431 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.760759 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.761096 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34032184-f088-41d7-ac8f-c5d8d46c60bb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.799349 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.819277 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.956866 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.959523 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:34.960662 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b2947e2d-ea21-4aca-8b28-18b38f47dc5b HTTP/1.1" status: 204 len: 168 time: 0.2078767 Jan 05 15:04:34.968944 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2947e2d-ea21-4aca-8b28-18b38f47dc5b,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:34.976039 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.978068 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.978068 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.978068 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.978068 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.978068 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.978068 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.978881 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.979082 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.979280 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.979601 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.979921 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:34.980239 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93598612-fa27-4763-8ee1-21376515b8d9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:04:35.600181 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 48982) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:35.613393 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c3f8635a-a0bb-4c02-8930-653a2f64b45b admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:35.687848 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c3f8635a-a0bb-4c02-8930-653a2f64b45b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:35.756539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c3f8635a-a0bb-4c02-8930-653a2f64b45b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:35.793724 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c3f8635a-a0bb-4c02-8930-653a2f64b45b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2e5eb27de7cc4a0cb52b0bc4af7d9cb1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1925116 Jan 05 15:04:35.794586 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f8635a-a0bb-4c02-8930-653a2f64b45b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6cd655c1-d5ce-4dd1-aadc-043ad2048af6,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:35.797004 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 48984) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:35.854948 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-934e93ca-ee8d-48bf-9740-e97524d0997a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:35.876267 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-934e93ca-ee8d-48bf-9740-e97524d0997a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:35.973808 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-934e93ca-ee8d-48bf-9740-e97524d0997a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:35.976308 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-934e93ca-ee8d-48bf-9740-e97524d0997a admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:35.977501 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-934e93ca-ee8d-48bf-9740-e97524d0997a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6cd655c1-d5ce-4dd1-aadc-043ad2048af6 HTTP/1.1" status: 204 len: 168 time: 0.1794987 Jan 05 15:04:35.985694 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-934e93ca-ee8d-48bf-9740-e97524d0997a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cd655c1-d5ce-4dd1-aadc-043ad2048af6,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:47.404259 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49156) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:47.506866 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-acd3f243-2291-4a6f-9398-9ec8a6ca887d admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:47.578117 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-acd3f243-2291-4a6f-9398-9ec8a6ca887d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:47.647739 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-acd3f243-2291-4a6f-9398-9ec8a6ca887d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:47.687153 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-acd3f243-2291-4a6f-9398-9ec8a6ca887d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c9a620e7cb7b4104b0ddd9b5ba0489dd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2795091 Jan 05 15:04:47.687153 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd3f243-2291-4a6f-9398-9ec8a6ca887d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2439f6ff-6bc7-4d91-a16d-b8fb7a3d2e74,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:47.687539 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49162) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:47.737554 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3973fb61-3328-4a7a-8d96-815af421bec7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:47.758244 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3973fb61-3328-4a7a-8d96-815af421bec7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:47.899287 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3973fb61-3328-4a7a-8d96-815af421bec7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:47.901907 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-3973fb61-3328-4a7a-8d96-815af421bec7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:47.903078 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-3973fb61-3328-4a7a-8d96-815af421bec7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2439f6ff-6bc7-4d91-a16d-b8fb7a3d2e74 HTTP/1.1" status: 204 len: 168 time: 0.2145648 Jan 05 15:04:47.911207 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3973fb61-3328-4a7a-8d96-815af421bec7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2439f6ff-6bc7-4d91-a16d-b8fb7a3d2e74,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:48.494423 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49170) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:48.511544 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2bcfcbb8-fecc-4968-a72d-5b76b0ca3fa0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:48.588982 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2bcfcbb8-fecc-4968-a72d-5b76b0ca3fa0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:48.678799 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2bcfcbb8-fecc-4968-a72d-5b76b0ca3fa0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:48.716675 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2bcfcbb8-fecc-4968-a72d-5b76b0ca3fa0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=890fd8f612f84eddae1d8fb064122783&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2211835 Jan 05 15:04:48.717821 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bcfcbb8-fecc-4968-a72d-5b76b0ca3fa0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3765f4d-5f1a-4ba7-9299-4da51645a2b4,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:48.719361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49174) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:48.766983 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9cef52c3-7768-46ae-b47a-7ed739d0a8ed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:48.787644 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9cef52c3-7768-46ae-b47a-7ed739d0a8ed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:48.918520 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9cef52c3-7768-46ae-b47a-7ed739d0a8ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:48.921184 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-9cef52c3-7768-46ae-b47a-7ed739d0a8ed admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:48.924185 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-9cef52c3-7768-46ae-b47a-7ed739d0a8ed admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d3765f4d-5f1a-4ba7-9299-4da51645a2b4 HTTP/1.1" status: 204 len: 168 time: 0.2037807 Jan 05 15:04:48.932595 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cef52c3-7768-46ae-b47a-7ed739d0a8ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3765f4d-5f1a-4ba7-9299-4da51645a2b4,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:49.568649 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49182) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:49.582232 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20998e00-4ec6-4589-a61d-f0e6ea46aa87 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:49.654734 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20998e00-4ec6-4589-a61d-f0e6ea46aa87 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:49.718521 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-20998e00-4ec6-4589-a61d-f0e6ea46aa87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:49.755362 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20998e00-4ec6-4589-a61d-f0e6ea46aa87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=077cb828-23cf-40ac-a3d6-8b603cdc5e6c,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:49.759956 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-20998e00-4ec6-4589-a61d-f0e6ea46aa87 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=8a903b583ddb45ae82c1e051dc7df0ce&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1902111 Jan 05 15:04:49.762685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49186) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:49.808157 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a6c79707-0eb1-4b0d-8d4c-bdc481c3c84c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:49.828702 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a6c79707-0eb1-4b0d-8d4c-bdc481c3c84c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:49.941400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a6c79707-0eb1-4b0d-8d4c-bdc481c3c84c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:49.943968 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a6c79707-0eb1-4b0d-8d4c-bdc481c3c84c admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:49.945107 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-a6c79707-0eb1-4b0d-8d4c-bdc481c3c84c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/077cb828-23cf-40ac-a3d6-8b603cdc5e6c HTTP/1.1" status: 204 len: 168 time: 0.1815088 Jan 05 15:04:49.952886 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c79707-0eb1-4b0d-8d4c-bdc481c3c84c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=077cb828-23cf-40ac-a3d6-8b603cdc5e6c,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:51.802162 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49222) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:51.903253 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-743bbb76-7000-40df-8fc2-34ecea954d9c admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:51.975435 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-743bbb76-7000-40df-8fc2-34ecea954d9c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:52.042189 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-743bbb76-7000-40df-8fc2-34ecea954d9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:52.080592 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-743bbb76-7000-40df-8fc2-34ecea954d9c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0c48e496a63e4d67b6c59e1c9c27297b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2771361 Jan 05 15:04:52.081860 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-743bbb76-7000-40df-8fc2-34ecea954d9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b5c7308-cb20-4737-9461-8ca4aa3b9aee,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:52.084121 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49228) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:04:52.137961 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ecfdc53f-b155-44f8-be89-0c56153e7cef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:52.158693 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ecfdc53f-b155-44f8-be89-0c56153e7cef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:52.324026 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ecfdc53f-b155-44f8-be89-0c56153e7cef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:52.326678 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ecfdc53f-b155-44f8-be89-0c56153e7cef admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:52.327796 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-ecfdc53f-b155-44f8-be89-0c56153e7cef admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8b5c7308-cb20-4737-9461-8ca4aa3b9aee HTTP/1.1" status: 204 len: 168 time: 0.2426600 Jan 05 15:04:52.335501 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecfdc53f-b155-44f8-be89-0c56153e7cef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b5c7308-cb20-4737-9461-8ca4aa3b9aee,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:04:58.227433 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-888087f4-ee3a-4d00-a2dd-35e4b2fd69c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:04:59.965831 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:05:00.368147 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-43b6cba2-54c5-4029-960c-7e1702755e8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:01.838153 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:02.712768 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:03.545205 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:04.427397 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.210801 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-f05ca379-4cd3-4859-b440-79a50e9de542 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1780740953&fields=id&tenant_id=b874b608d2c848a88541148e56d2114d HTTP/1.1" status: 200 len: 267 time: 0.0426910 Jan 05 15:05:06.262173 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-22b09a0c-3220-4f6b-afb4-2bd0cc732edb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:06.263505 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-22b09a0c-3220-4f6b-afb4-2bd0cc732edb tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 985 time: 0.0476882 Jan 05 15:05:06.274600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Request body: {'port': {'security_groups': ['93cf9114-46da-4d77-8e9e-dda0c5b575f3']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:05:06.341429 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.522844 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:06.552062 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.643794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.681552 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['4bda96b8-bc6e-4586-8d4d-5a66846e4b96'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:05:06.686609 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:06.687296 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.688669 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-04cd05a8-7108-4f87-896c-b2f8c8bee0c6 req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "PUT /v2.0/ports/4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 943 time: 0.4188495 Jan 05 15:05:06.689134 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:05:06.691367 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c" -d '{"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:05:06.696458 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49330) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:06.740581 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b4c5b9e-389e-4f18-a74b-3c102d3d095a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event updated for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=7']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:06.785566 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5f780a29-a195-4a92-9491-6d973d551054 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.823730 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5f780a29-a195-4a92-9491-6d973d551054 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.873490 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['4bda96b8-bc6e-4586-8d4d-5a66846e4b96'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:05:06.987759 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:05:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28318c30-090f-4925-bb30-67466d8c60e2 x-openstack-request-id: req-28318c30-090f-4925-bb30-67466d8c60e2 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:05:06.987759 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:05:06.987759 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-28318c30-090f-4925-bb30-67466d8c60e2 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:05:06.988403 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'status': 'completed', 'code': 200} Jan 05 15:05:06.996528 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5f780a29-a195-4a92-9491-6d973d551054 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:06.999263 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5f780a29-a195-4a92-9491-6d973d551054 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.003014 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-5f780a29-a195-4a92-9491-6d973d551054 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "DELETE /v2.0/security-groups/2767f584-b06b-4dab-a69f-33162778019e HTTP/1.1" status: 204 len: 168 time: 0.3032897 Jan 05 15:05:07.003575 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49342) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:07.049400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f780a29-a195-4a92-9491-6d973d551054 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2767f584-b06b-4dab-a69f-33162778019e,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:07.053797 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-9a5c7935-eef1-4569-a8c4-c7ad6a7878c8 None None] Provisioning complete for port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:05:07.054483 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-9a5c7935-eef1-4569-a8c4-c7ad6a7878c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.189957 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Deleting port 02cf9cef-0f4f-4154-a19c-cb823e93b90a {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:07.190299 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.271539 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.271937 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.283611 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling delete_port for 02cf9cef-0f4f-4154-a19c-cb823e93b90a owned by network:floatingip {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:07.360859 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682db42b-a6bc-422f-8347-bbc66011bf9f req-78d78877-1349-4fa3-936b-2ee675faa742 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:07.365556 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-682db42b-a6bc-422f-8347-bbc66011bf9f req-78d78877-1349-4fa3-936b-2ee675faa742 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.3184128 Jan 05 15:05:07.416600 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-682db42b-a6bc-422f-8347-bbc66011bf9f req-a9e084e2-5e36-484a-b290-69a1c824e057 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480404 Jan 05 15:05:07.468623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-3d86dd4b-71cc-4461-a7c1-18a9566d99b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:07.474127 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-3d86dd4b-71cc-4461-a7c1-18a9566d99b3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1099 time: 0.4190059 Jan 05 15:05:07.541833 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.564126 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-a422f8b6-c713-4fcd-8ad0-94dc0b75ff99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:07.565987 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-a422f8b6-c713-4fcd-8ad0-94dc0b75ff99 service neutron] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 915 time: 0.0888410 Jan 05 15:05:07.567923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event deleted for resources: {'Port': ['ID=02cf9cef-0f4f-4154-a19c-cb823e93b90a,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:07.615707 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-fb053556-93ae-474c-b7f6-04960896c1d6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 217 time: 0.0413687 Jan 05 15:05:07.631340 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks [] for floatingip, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.632059 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Floating IP b48e1723-803e-4342-87a9-9162f75d5313 disassociated (deleted). External IP: 172.37.2.27, port: 4bda96b8-bc6e-4586-8d4d-5a66846e4b96. Jan 05 15:05:07.666263 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-d181dd0a-0fa0-4116-a296-79c2c662d4bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:07.667717 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-d181dd0a-0fa0-4116-a296-79c2c662d4bb service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.0455377 Jan 05 15:05:07.711206 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-32c9df5b-8f89-40ad-b8b9-97a47452f764 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:07.713454 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-32c9df5b-8f89-40ad-b8b9-97a47452f764 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0396855 Jan 05 15:05:07.801142 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-c5029cff-5923-4fe6-a989-7055ffb16508 service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814130 Jan 05 15:05:07.834999 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:05:07.890982 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e86959c3-c57b-4e1e-a2c3-b42e95c56e3c req-56a19ac2-0fef-4d67-9ccc-0bd864ba213c service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834963 Jan 05 15:05:07.939096 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:05:07.943480 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:07.948825 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] Sync routers for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:05:07.962476 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:07.963087 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:07.969946 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d54f1706-398b-493a-8ad5-c37076a2446f tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "DELETE /v2.0/floatingips/b48e1723-803e-4342-87a9-9162f75d5313 HTTP/1.1" status: 204 len: 168 time: 0.9646888 Jan 05 15:05:07.970758 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:05:07.973110 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbe39e4d-b164-4549-ba23-b68075585afe" -d '{"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:05:08.074956 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:08.079415 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:05:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bad9773-62c1-400c-9c4d-badefd62d979 x-openstack-request-id: req-4bad9773-62c1-400c-9c4d-badefd62d979 {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:05:08.079889 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:05:08.079982 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4bad9773-62c1-400c-9c4d-badefd62d979 {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:05:08.080350 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'status': 'completed', 'code': 200} Jan 05 15:05:08.175430 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe39e4d-b164-4549-ba23-b68075585afe req-7e4a8926-0484-4255-ad1b-6f269ab5e19b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:08.177008 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-7e4a8926-0484-4255-ad1b-6f269ab5e19b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=b874b608d2c848a88541148e56d2114d&device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 1099 time: 0.0457828 Jan 05 15:05:08.278399 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe39e4d-b164-4549-ba23-b68075585afe req-7d5e7918-9cb9-477d-8e31-abf81c658890 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:08.279867 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-7d5e7918-9cb9-477d-8e31-abf81c658890 service neutron] 10.222.0.13 "GET /v2.0/networks?id=88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 200 len: 915 time: 0.0945282 Jan 05 15:05:08.295607 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:20Z', 'revision_number': 5, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:08.320888 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-5de45752-3bcb-40f3-8d35-0e24e3e033ad service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 200 len: 217 time: 0.0342519 Jan 05 15:05:08.321515 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] Checking router: 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:05:08.329744 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:08.330344 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:08.378009 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe39e4d-b164-4549-ba23-b68075585afe req-00e36e9e-ecc6-4024-9d74-a57a8eef3a7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:08.379550 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-00e36e9e-ecc6-4024-9d74-a57a8eef3a7d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 200 len: 853 time: 0.0527413 Jan 05 15:05:08.432009 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe39e4d-b164-4549-ba23-b68075585afe req-ed0b77b4-7f3e-47f8-b2cf-08ce0260a1b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:08.433623 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-ed0b77b4-7f3e-47f8-b2cf-08ce0260a1b0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=88c2382a-d403-4004-b3bd-23c5e1ff004f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0478821 Jan 05 15:05:08.442393 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:08.541439 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-11c5671f-03e8-4eb7-91b2-2b3f251cc12c service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1005850 Jan 05 15:05:08.558468 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb req-f6e5fbe5-6bad-4b78-b100-00dd273a09eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:08.559961 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb req-f6e5fbe5-6bad-4b78-b100-00dd273a09eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0558035 Jan 05 15:05:08.621800 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f79b541f-6d62-4473-a1fc-f4de4f52d1bb req-b61ae3d8-6849-4f13-b3e2-8e5ad29b4163 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0561373 Jan 05 15:05:08.655568 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bbe39e4d-b164-4549-ba23-b68075585afe req-9252daf1-8014-47a8-957d-6eec8a849fed service neutron] 10.222.0.13 "GET /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1038287 Jan 05 15:05:08.671244 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:20Z', 'revision_number': 5, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:08.699427 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15faa82a-4491-4b9e-afde-edda535fad1a None None] The sync data for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi is: [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:02:15Z', 'revision_number': 4, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '4428e5e5-ac3c-4539-9416-7d271e12d15a', 'name': '', 'network_id': '88c2382a-d403-4004-b3bd-23c5e1ff004f', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'mac_address': 'fa:16:3e:5b:ea:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:15Z', 'updated_at': '2022-01-05T15:02:20Z', 'revision_number': 5, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'subnets': [{'id': '8f70bd05-fae0-4a73-a39b-d1442f8ef93c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:05:08.912126 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea9d2dae-49f2-429e-95e7-955f26672287 None None] New status for floating IP b48e1723-803e-4342-87a9-9162f75d5313: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:05:09.756707 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1edecd96-1de1-4055-8b1e-212e4bda9dee req-23b61a85-cf32-472b-b14e-62835e036cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:09.758182 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1edecd96-1de1-4055-8b1e-212e4bda9dee req-23b61a85-cf32-472b-b14e-62835e036cd5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0479774 Jan 05 15:05:09.806618 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1edecd96-1de1-4055-8b1e-212e4bda9dee req-63ea6f40-8f5c-4c33-aad8-ccb25b26d7ad tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430176 Jan 05 15:05:10.923527 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b3931e-0127-4223-87f8-02d018cdbaa9 req-84858d92-dc6a-4656-82fb-c78659dd2284 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:10.925000 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-25b3931e-0127-4223-87f8-02d018cdbaa9 req-84858d92-dc6a-4656-82fb-c78659dd2284 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0484774 Jan 05 15:05:10.970737 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-25b3931e-0127-4223-87f8-02d018cdbaa9 req-d6a0e123-692f-4c7b-9ef6-31448c034035 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400600 Jan 05 15:05:12.088513 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 req-cc594ea3-944f-4b1e-a5e2-03c45f219ff4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:12.090007 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 req-cc594ea3-944f-4b1e-a5e2-03c45f219ff4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0485411 Jan 05 15:05:12.136246 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c8a4086e-8a72-4880-9bbf-ace7cffde2e5 req-54045bbe-1d38-4c97-b544-96e3feb19453 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405476 Jan 05 15:05:13.255391 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e74c675-29ef-496f-98e0-008f36bdb2c6 req-cc00cc4e-a2e2-4bb4-8d28-8f3daf620bd6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:13.257637 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1e74c675-29ef-496f-98e0-008f36bdb2c6 req-cc00cc4e-a2e2-4bb4-8d28-8f3daf620bd6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0502708 Jan 05 15:05:13.304287 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1e74c675-29ef-496f-98e0-008f36bdb2c6 req-e75d1ff2-bc9a-4555-ad84-1f7701b84f24 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410025 Jan 05 15:05:14.435083 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57cfe6f9-2c34-420f-8c32-661c07df426c req-7a50b10d-8cfc-4e7d-bb59-686f7844a2a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:14.436621 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-57cfe6f9-2c34-420f-8c32-661c07df426c req-7a50b10d-8cfc-4e7d-bb59-686f7844a2a1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0529289 Jan 05 15:05:14.468089 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6e57b7-ba76-4ddb-95db-430f744732e7 req-b492c231-06a8-4abf-a59e-5e3c2a11f13d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:14.469492 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fc6e57b7-ba76-4ddb-95db-430f744732e7 req-b492c231-06a8-4abf-a59e-5e3c2a11f13d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0589788 Jan 05 15:05:14.487083 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-57cfe6f9-2c34-420f-8c32-661c07df426c req-d13dd63d-8558-4695-8b56-2eaa8f2fc7b4 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443683 Jan 05 15:05:14.524188 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fc6e57b7-ba76-4ddb-95db-430f744732e7 req-73857ebe-7e27-4207-af24-ea3f19bbc81a tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451922 Jan 05 15:05:15.613643 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7fa794-ed1a-476e-a49a-65b5d0784836 req-2ae7a73d-fca1-4c09-ab2f-75d154c101d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:15.615014 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5f7fa794-ed1a-476e-a49a-65b5d0784836 req-2ae7a73d-fca1-4c09-ab2f-75d154c101d9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0532422 Jan 05 15:05:15.638455 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4874c7a3-3d40-42ac-8530-6f16a6d479ac req-0882d906-6818-4930-ae17-e18d7a5d506b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:15.640132 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4874c7a3-3d40-42ac-8530-6f16a6d479ac req-0882d906-6818-4930-ae17-e18d7a5d506b tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0490410 Jan 05 15:05:15.662124 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5f7fa794-ed1a-476e-a49a-65b5d0784836 req-bfcb7603-8333-4e48-b3a6-35c94641e96a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409935 Jan 05 15:05:15.687338 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4874c7a3-3d40-42ac-8530-6f16a6d479ac req-e1ca4f75-d8cd-421f-b4ca-f0e9b2ed257d tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/security-groups?id=93cf9114-46da-4d77-8e9e-dda0c5b575f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415885 Jan 05 15:05:16.275046 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-3414ded4-7df2-4506-81de-beb064f0afbf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:16.276395 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-3414ded4-7df2-4506-81de-beb064f0afbf tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.13 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 946 time: 0.0471418 Jan 05 15:05:16.367103 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Deleting port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:16.367445 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:16.451810 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] For port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:16.452168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:16.465208 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Calling delete_port for 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:16.653370 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:16.679171 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Pushing event deleted for resources: {'Port': ['ID=4bda96b8-bc6e-4586-8d4d-5a66846e4b96,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:16.693876 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['4bda96b8-bc6e-4586-8d4d-5a66846e4b96'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:05:16.738920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] No DVR routers for this DVR port 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:16.742663 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:16.745986 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1d7bb6c1-f9e7-40a6-88cf-410f4bee31a9 req-97041864-b3f8-47f3-b037-9284928b6647 tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.13 "DELETE /v2.0/ports/4bda96b8-bc6e-4586-8d4d-5a66846e4b96 HTTP/1.1" status: 204 len: 173 time: 0.4649918 Jan 05 15:05:16.747022 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'name': 'network-vif-deleted', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:05:16.749247 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac423a00-1a2a-4b31-8c41-3cfc03642b6f" -d '{"events": [{"server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "name": "network-vif-deleted", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:05:16.786597 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a1ad977c-7260-42c9-8d4b-7f53bc471777 req-899305b3-d183-4c8b-9500-eb018f17fd8e tempest-TestMinimumBasicScenario-938599888 tempest-TestMinimumBasicScenario-938599888-project] 10.222.0.30 "GET /v2.0/ports?device_id=22497ce1-6400-4f16-a962-dce627a97693 HTTP/1.1" status: 200 len: 210 time: 0.0248387 Jan 05 15:05:16.803260 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c446176-104e-4fc7-9c09-3adfb7c22563 req-11010179-c5c9-4774-9a2b-fe6bc5b8f260 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:16.805546 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7c446176-104e-4fc7-9c09-3adfb7c22563 req-11010179-c5c9-4774-9a2b-fe6bc5b8f260 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0647945 Jan 05 15:05:16.831786 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:05:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c99fff33-d52d-440c-9238-202c2d591f53 x-openstack-request-id: req-c99fff33-d52d-440c-9238-202c2d591f53 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:05:16.832074 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "22497ce1-6400-4f16-a962-dce627a97693", "name": "network-vif-deleted", "tag": "4bda96b8-bc6e-4586-8d4d-5a66846e4b96", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:05:16.832326 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c99fff33-d52d-440c-9238-202c2d591f53 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:05:16.832716 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '22497ce1-6400-4f16-a962-dce627a97693', 'name': 'network-vif-deleted', 'tag': '4bda96b8-bc6e-4586-8d4d-5a66846e4b96', 'status': 'completed', 'code': 200} Jan 05 15:05:16.856617 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7c446176-104e-4fc7-9c09-3adfb7c22563 req-fcd9e955-3065-408e-96ae-33676dd41a68 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448694 Jan 05 15:05:17.981843 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c93ef31-38dd-4114-8eca-2401c1b8d47e req-3f273b0f-8bdb-4be9-bd71-ccedc09dba9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:17.983376 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9c93ef31-38dd-4114-8eca-2401c1b8d47e req-3f273b0f-8bdb-4be9-bd71-ccedc09dba9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0539362 Jan 05 15:05:18.032521 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9c93ef31-38dd-4114-8eca-2401c1b8d47e req-ac8b3f8d-1bc4-463a-9d8b-0c2db237960d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432267 Jan 05 15:05:19.154821 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c215518-5cc2-441f-bfc3-28ad88102f35 req-2b9b3de7-160c-4975-86bb-df54750f23e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:19.156294 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6c215518-5cc2-441f-bfc3-28ad88102f35 req-2b9b3de7-160c-4975-86bb-df54750f23e5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0494950 Jan 05 15:05:19.202763 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6c215518-5cc2-441f-bfc3-28ad88102f35 req-41d4741f-35e2-4b7f-97fb-d40dbf5b35ca tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408006 Jan 05 15:05:19.218990 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49496) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:19.579371 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:19.816950 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Deleting port 4428e5e5-ac3c-4539-9416-7d271e12d15a {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:19.817215 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:19.899672 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] For port 4428e5e5-ac3c-4539-9416-7d271e12d15a, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4428e5e5-ac3c-4539-9416-7d271e12d15a,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:19.900032 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:19.911964 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Calling delete_port for 4428e5e5-ac3c-4539-9416-7d271e12d15a owned by network:router_interface {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:19.959626 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:19.979476 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:19.979825 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 4bda96b8-bc6e-4586-8d4d-5a66846e4b96 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:20.181373 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:20.204369 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=4428e5e5-ac3c-4539-9416-7d271e12d15a,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:20.634234 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 req-f31cf366-44d1-45ea-a01b-59cf79c2a763 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:20.635673 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 req-f31cf366-44d1-45ea-a01b-59cf79c2a763 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.3270638 Jan 05 15:05:20.650260 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:20.723579 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ddcfea41-2d6d-4f18-b2a9-7c0c1d61a989 req-09cae74b-f513-49ee-abda-409b57b24253 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0812423 Jan 05 15:05:20.887101 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:05:20.991696 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:05:20.997213 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-0455ede7-af1b-42ef-81c4-6cf5ba8839b2 admin admin] 10.222.0.30 "PUT /v2.0/routers/2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7765632 Jan 05 15:05:20.999402 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49504) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:21.002090 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] Sync routers for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:05:21.012879 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:21.013528 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:21.100476 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks [] for router, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.117514 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:21.212392 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.306961 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24'}], 'enable_snat': True}, 'gw_port_id': '85c20f33-d1cf-4828-9db0-93081197debc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:05:20Z', 'revision_number': 5, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port': {'id': '85c20f33-d1cf-4828-9db0-93081197debc', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:a8:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:12Z', 'updated_at': '2022-01-05T15:02:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:21.333255 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] Checking router: 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:05:21.341492 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] Routers {'2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:21.342081 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:21.355691 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Deleting port 85c20f33-d1cf-4828-9db0-93081197debc {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:21.356037 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.426555 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] Set router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 gateway port host: None {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:21.432536 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] For port 85c20f33-d1cf-4828-9db0-93081197debc, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=85c20f33-d1cf-4828-9db0-93081197debc,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:21.432905 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.445812 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Calling delete_port for 85c20f33-d1cf-4828-9db0-93081197debc owned by network:router_gateway {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:21.478998 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:05:21Z', 'revision_number': 6, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:21.511963 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72212b33-44cd-406b-af28-39a7ef1c7c5d None None] The sync data for ids ['2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9'] in dv-cinder-master-3-iscsi is: [{'id': '2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9', 'name': 'tempest-TestMinimumBasicScenario-921748022-router', 'tenant_id': 'b874b608d2c848a88541148e56d2114d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:11Z', 'updated_at': '2022-01-05T15:05:21Z', 'revision_number': 6, 'project_id': 'b874b608d2c848a88541148e56d2114d', 'gw_port_host': None}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:05:21.704535 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.733659 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Pushing event deleted for resources: {'Port': ['ID=85c20f33-d1cf-4828-9db0-93081197debc,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:21.798141 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.867739 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf req-40f53da6-864b-4171-bff4-7c62acd267ed tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:21.870026 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf req-40f53da6-864b-4171-bff4-7c62acd267ed tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0654995 Jan 05 15:05:21.918249 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.921702 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:21.933357 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d4f7db70-729c-4f2a-8c0d-ee5910ab31bf req-333441f3-1b80-4a14-9337-ba04fb489978 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0551512 Jan 05 15:05:22.089706 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.090269 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 {{(pid=114655) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:05:22.095485 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.096515 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-e806c591-6dc0-4ae6-952c-67604c2bfdff admin admin] 10.222.0.30 "DELETE /v2.0/routers/2766c8b7-8c29-40ad-abef-5fdf0a7d4ca9 HTTP/1.1" status: 204 len: 168 time: 1.0962217 Jan 05 15:05:22.099944 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49510) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:22.150737 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] Deleting subnet 8f70bd05-fae0-4a73-a39b-d1442f8ef93c {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:05:22.154329 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.188333 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.294745 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.330401 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4428e5e5-ac3c-4539-9416-7d271e12d15a no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:22.350188 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 4428e5e5-ac3c-4539-9416-7d271e12d15a {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:22.350538 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4428e5e5-ac3c-4539-9416-7d271e12d15a not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:22.352932 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 85c20f33-d1cf-4828-9db0-93081197debc no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:22.370820 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 85c20f33-d1cf-4828-9db0-93081197debc {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:22.371188 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 85c20f33-d1cf-4828-9db0-93081197debc not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:22.416049 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.441512 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8f70bd05-fae0-4a73-a39b-d1442f8ef93c,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:22.445159 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.448337 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9d10dfc8-d6da-471e-92ce-ba5dd924d012 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/8f70bd05-fae0-4a73-a39b-d1442f8ef93c HTTP/1.1" status: 204 len: 168 time: 0.3474710 Jan 05 15:05:22.450924 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49512) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:22.454216 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4be22822-752d-4ceb-9a3e-cc0075ff3992 None None] Network 88c2382a-d403-4004-b3bd-23c5e1ff004f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:05:22.533620 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.602798 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Deleting port 4093508d-2456-48b1-bd62-3140d1b5dfa7 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:22.602798 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.664756 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] For port 4093508d-2456-48b1-bd62-3140d1b5dfa7, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4093508d-2456-48b1-bd62-3140d1b5dfa7,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:22.665161 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.678248 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Calling delete_port for 4093508d-2456-48b1-bd62-3140d1b5dfa7 owned by network:dhcp {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:22.740603 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] DHCP port deletion for 88c2382a-d403-4004-b3bd-23c5e1ff004f request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:05:22.789676 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Deleting port 4093508d-2456-48b1-bd62-3140d1b5dfa7 {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:22.789963 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.836395 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.858907 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] For port 4093508d-2456-48b1-bd62-3140d1b5dfa7, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4093508d-2456-48b1-bd62-3140d1b5dfa7,segment=NetworkSegment(4f800182-f71d-4001-8825-29298b38881e),segment_id=4f800182-f71d-4001-8825-29298b38881e)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:22.859304 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.864148 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] No DVR routers for this DVR port 4093508d-2456-48b1-bd62-3140d1b5dfa7 on host dv-cinder-master-3-iscsi {{(pid=114655) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:22.870141 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Pushing event deleted for resources: {'Port': ['ID=4093508d-2456-48b1-bd62-3140d1b5dfa7,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:22.877223 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Calling delete_port for 4093508d-2456-48b1-bd62-3140d1b5dfa7 owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:22.941481 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:22.965868 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['88c2382a-d403-4004-b3bd-23c5e1ff004f']}} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:22.976969 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f800182-f71d-4001-8825-29298b38881e') {'for_net_delete': True} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:22.977285 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f800182-f71d-4001-8825-29298b38881e') {} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:22.988309 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4701328'] for segment, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.002179 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.006567 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.013127 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Releasing vlan 137 on physical network physnet1 to pool {{(pid=114655) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:05:23.013523 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4698958'] for segment, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: Traceback (most recent call last): Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: timer() Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: cb(*args, **kw) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: return func(*args, **kwargs) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: self._notify() Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: self.callback(batched_events) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: event.method(event) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: return f(self, *a, **k) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: return self._get(url).json() Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: return self.request(url, 'GET', **kwargs) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:05:23.015315 dv-cinder-master-3-iscsi neutron-server[114655]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:05:23.031266 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Pushing event deleted for resources: {'Port': ['ID=4093508d-2456-48b1-bd62-3140d1b5dfa7,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:23.035922 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] No DVR routers for this DVR port 4093508d-2456-48b1-bd62-3140d1b5dfa7 on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:23.042397 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.042764 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.043181 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.043588 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.044114 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.044636 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.044976 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.045342 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.045680 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.046031 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.046373 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.046705 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.047033 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de583c9-85bf-467c-a09a-f2868ab0c2b9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:23.060900 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef3763b-c5c4-4644-bcef-3bb3bf5173da req-8284c6f3-971e-40e0-bc85-8fce40b3c5b9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:23.062725 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-eef3763b-c5c4-4644-bcef-3bb3bf5173da req-8284c6f3-971e-40e0-bc85-8fce40b3c5b9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0527706 Jan 05 15:05:23.114604 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-eef3763b-c5c4-4644-bcef-3bb3bf5173da req-c9ec3cb5-195e-4532-8379-e87ed3015386 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453951 Jan 05 15:05:23.161924 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.167676 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.170808 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] 10.222.0.30 "DELETE /v2.0/networks/88c2382a-d403-4004-b3bd-23c5e1ff004f HTTP/1.1" status: 204 len: 168 time: 0.7189660 Jan 05 15:05:23.173846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49524) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:23.181577 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b55f76-8940-42e0-9945-fff411793258 admin admin] Pushing event deleted for resources: {'Network': ['ID=88c2382a-d403-4004-b3bd-23c5e1ff004f,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:23.579058 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.870761 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Deleting port 6f356e12-c763-4764-a58c-8fbea3babcad {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:23.871101 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.945199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] For port 6f356e12-c763-4764-a58c-8fbea3babcad, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6f356e12-c763-4764-a58c-8fbea3babcad,segment=NetworkSegment(5fc64c84-d896-467c-ad80-83d994431561),segment_id=5fc64c84-d896-467c-ad80-83d994431561)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:23.945586 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:23.957560 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Calling delete_port for 6f356e12-c763-4764-a58c-8fbea3babcad owned by network:router_interface {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:24.076759 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4093508d-2456-48b1-bd62-3140d1b5dfa7 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:24.096438 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 4093508d-2456-48b1-bd62-3140d1b5dfa7 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:24.096863 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4093508d-2456-48b1-bd62-3140d1b5dfa7 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:24.240918 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5d1a53-8263-4f87-ae45-06ecae5313b3 req-733f8366-831b-4011-b0b4-fc67bf346d73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:24.242995 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-af5d1a53-8263-4f87-ae45-06ecae5313b3 req-733f8366-831b-4011-b0b4-fc67bf346d73 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0518401 Jan 05 15:05:24.287592 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-af5d1a53-8263-4f87-ae45-06ecae5313b3 req-88e8e17d-07c2-45d9-aa77-329f1ed1e814 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391753 Jan 05 15:05:24.287800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:24.314986 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Pushing event deleted for resources: {'Port': ['ID=6f356e12-c763-4764-a58c-8fbea3babcad,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:24.477325 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:24.938069 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Router 91b221f6-566d-474c-8811-df9475b6ebfe has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:05:25.042643 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:05:25.047743 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-e9e5b4fd-ce24-4932-aad4-782c70c18077 admin admin] 10.222.0.30 "PUT /v2.0/routers/91b221f6-566d-474c-8811-df9475b6ebfe/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8727894 Jan 05 15:05:25.050297 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49540) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:25.052976 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-316e666e-2330-4d4c-949f-a23787030238 None None] Sync routers for ids ['91b221f6-566d-474c-8811-df9475b6ebfe'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:05:25.064663 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] Routers {'91b221f6-566d-474c-8811-df9475b6ebfe'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:25.065328 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['91b221f6-566d-474c-8811-df9475b6ebfe'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:25.157168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks [] for router, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:25.168218 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] Set router 91b221f6-566d-474c-8811-df9475b6ebfe gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:25.262236 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:25.353902 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210'}], 'enable_snat': True}, 'gw_port_id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:05:24Z', 'revision_number': 5, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port': {'id': 'e4a8a036-11d1-4e94-99b6-cd4135f12991', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:2a:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:21Z', 'updated_at': '2022-01-05T15:02:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:25.384658 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-316e666e-2330-4d4c-949f-a23787030238 None None] Checking router: 91b221f6-566d-474c-8811-df9475b6ebfe for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:05:25.393216 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] Routers {'91b221f6-566d-474c-8811-df9475b6ebfe'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:25.393838 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['91b221f6-566d-474c-8811-df9475b6ebfe'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:25.438359 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51daea24-71cf-456e-a074-fa9fe8b2a942 req-4f15b581-5011-4f6c-a7ac-a8a8ed6edcaf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:25.439850 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51daea24-71cf-456e-a074-fa9fe8b2a942 req-4f15b581-5011-4f6c-a7ac-a8a8ed6edcaf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0607305 Jan 05 15:05:25.450990 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Deleting port e4a8a036-11d1-4e94-99b6-cd4135f12991 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:25.451341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:25.480892 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] Set router 91b221f6-566d-474c-8811-df9475b6ebfe gateway port host: None {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:25.536439 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-316e666e-2330-4d4c-949f-a23787030238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:05:25Z', 'revision_number': 6, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:25.542813 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-51daea24-71cf-456e-a074-fa9fe8b2a942 req-eedbd680-4831-4e23-85b0-51056e08efce tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0941868 Jan 05 15:05:25.562689 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-316e666e-2330-4d4c-949f-a23787030238 None None] The sync data for ids ['91b221f6-566d-474c-8811-df9475b6ebfe'] in dv-cinder-master-3-iscsi is: [{'id': '91b221f6-566d-474c-8811-df9475b6ebfe', 'name': 'tempest-TestMinimumBasicScenario-1323676408-router', 'tenant_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:20Z', 'updated_at': '2022-01-05T15:05:25Z', 'revision_number': 6, 'project_id': 'c9dbadb18d1c4e888fda9d242ffdaf05', 'gw_port_host': None}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:05:25.574344 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] For port e4a8a036-11d1-4e94-99b6-cd4135f12991, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e4a8a036-11d1-4e94-99b6-cd4135f12991,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:25.574753 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:25.588854 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Calling delete_port for e4a8a036-11d1-4e94-99b6-cd4135f12991 owned by network:router_gateway {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:25.858959 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:25.886424 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=e4a8a036-11d1-4e94-99b6-cd4135f12991,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:25.958312 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.020988 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:05:26.051383 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.053497 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.129124 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:26.139809 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'port_id': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'mac_address': 'fa:16:3e:f0:40:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:05:26.176933 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.193319 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 0d57813b-5531-41c7-8d8d-8b2fc393b843 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:05:26.223354 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:26.250688 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.251927 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 91b221f6-566d-474c-8811-df9475b6ebfe {{(pid=114654) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:05:26.258496 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.262339 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49576) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:26.262774 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-fe9e87a7-f00b-4f64-be6e-97f7931b10c5 admin admin] 10.222.0.30 "DELETE /v2.0/routers/91b221f6-566d-474c-8811-df9475b6ebfe HTTP/1.1" status: 204 len: 168 time: 1.2111530 Jan 05 15:05:26.308697 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] Deleting subnet 7f49c491-a2a8-42a7-95de-10fbdafda631 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:05:26.323927 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.357939 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.416923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.479503 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=6']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:26.525392 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['0d57813b-5531-41c7-8d8d-8b2fc393b843'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:05:26.578427 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6f356e12-c763-4764-a58c-8fbea3babcad no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:26.594589 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.608126 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 6f356e12-c763-4764-a58c-8fbea3babcad {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:26.609349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6f356e12-c763-4764-a58c-8fbea3babcad not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:26.610225 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device e4a8a036-11d1-4e94-99b6-cd4135f12991 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:26.649191 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: e4a8a036-11d1-4e94-99b6-cd4135f12991 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:26.658118 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device e4a8a036-11d1-4e94-99b6-cd4135f12991 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:26.738751 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded3c757-b2ed-49ad-a90e-7c3488cc64af req-4b1460dd-c986-4797-9980-bd77a2abc80a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:26.738751 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ded3c757-b2ed-49ad-a90e-7c3488cc64af req-4b1460dd-c986-4797-9980-bd77a2abc80a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 944 time: 0.0728221 Jan 05 15:05:26.809485 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ded3c757-b2ed-49ad-a90e-7c3488cc64af req-5e0c07ac-772b-46d4-baa2-3e2a0a3cef6a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0704172 Jan 05 15:05:26.817848 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.853778 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7f49c491-a2a8-42a7-95de-10fbdafda631,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:26.856425 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:26.859650 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-fd66292c-4eb2-4ade-b8ac-35f624ab3c44 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/7f49c491-a2a8-42a7-95de-10fbdafda631 HTTP/1.1" status: 204 len: 168 time: 0.5961862 Jan 05 15:05:26.862509 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49582) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:26.866359 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fb881c1-fb92-410b-af0b-bf3152c2315e None None] Network 7441d551-57f6-41fa-83f4-a4a20584abd5 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:05:26.977889 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.053270 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Deleting port 3dcd533d-f5d8-4fc9-990f-04dd59906592 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:27.053623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.077566 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] DHCP port deletion for 7441d551-57f6-41fa-83f4-a4a20584abd5 request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:05:27.151187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] For port 3dcd533d-f5d8-4fc9-990f-04dd59906592, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3dcd533d-f5d8-4fc9-990f-04dd59906592,segment=NetworkSegment(5fc64c84-d896-467c-ad80-83d994431561),segment_id=5fc64c84-d896-467c-ad80-83d994431561)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:27.151187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.166374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] Deleting port 3dcd533d-f5d8-4fc9-990f-04dd59906592 {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:27.168185 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.168954 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Calling delete_port for 3dcd533d-f5d8-4fc9-990f-04dd59906592 owned by network:dhcp {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:27.245247 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] For port 3dcd533d-f5d8-4fc9-990f-04dd59906592, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3dcd533d-f5d8-4fc9-990f-04dd59906592,segment=NetworkSegment(5fc64c84-d896-467c-ad80-83d994431561),segment_id=5fc64c84-d896-467c-ad80-83d994431561)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:27.245646 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.261857 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] Calling delete_port for 3dcd533d-f5d8-4fc9-990f-04dd59906592 owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:27.350548 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.377475 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] No DVR routers for this DVR port 3dcd533d-f5d8-4fc9-990f-04dd59906592 on host dv-cinder-master-3-iscsi {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:27.382407 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.411182 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Pushing event deleted for resources: {'Port': ['ID=3dcd533d-f5d8-4fc9-990f-04dd59906592,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:27.439591 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] Pushing event deleted for resources: {'Port': ['ID=3dcd533d-f5d8-4fc9-990f-04dd59906592,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:27.460417 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2686d2fa-cb35-46c8-ad67-e6e1dc3a4fca None None] No DVR routers for this DVR port 3dcd533d-f5d8-4fc9-990f-04dd59906592 on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:27.519500 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.548291 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7441d551-57f6-41fa-83f4-a4a20584abd5']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:27.559334 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5fc64c84-d896-467c-ad80-83d994431561') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:27.559732 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5fc64c84-d896-467c-ad80-83d994431561') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:27.575496 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.592499 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.599962 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:05:27.600370 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:05:27.602913 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:05:27.767752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.781893 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:27.784891 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] 10.222.0.30 "DELETE /v2.0/networks/7441d551-57f6-41fa-83f4-a4a20584abd5 HTTP/1.1" status: 204 len: 168 time: 0.9185259 Jan 05 15:05:27.800800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce92eb5c-2886-430b-ac4b-7fd91615bbd4 admin admin] Pushing event deleted for resources: {'Network': ['ID=7441d551-57f6-41fa-83f4-a4a20584abd5,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:27.948375 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c592ed-e6af-41e5-8579-a6cf5b0150cf req-a2c1e890-47fd-4d99-8dfe-78c6efb73d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:27.949986 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-18c592ed-e6af-41e5-8579-a6cf5b0150cf req-a2c1e890-47fd-4d99-8dfe-78c6efb73d59 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 944 time: 0.0624332 Jan 05 15:05:28.009113 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-18c592ed-e6af-41e5-8579-a6cf5b0150cf req-0f35f914-a2f2-4ea5-99ab-33df567ad3f8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529597 Jan 05 15:05:28.052650 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:05:28.109165 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 3dcd533d-f5d8-4fc9-990f-04dd59906592 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:28.141084 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 3dcd533d-f5d8-4fc9-990f-04dd59906592 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:28.141517 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 3dcd533d-f5d8-4fc9-990f-04dd59906592 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:28.148589 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 0d57813b-5531-41c7-8d8d-8b2fc393b843 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:05:28.148995 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.197285 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-7a24a166-a05a-4c0a-ac16-8ae9cdebedbd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.235575 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.263075 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:05:28.265362 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb64be98-49d6-48c7-9405-65f209ad6923" -d '{"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:05:28.278580 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:28.305617 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49596) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:28.356154 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.421450 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-52f927ad-2a33-4895-9187-87f145201f2a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b874b608d2c848a88541148e56d2114d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1144495 Jan 05 15:05:28.423966 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49598) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:28.461977 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=7']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:28.502293 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d4a4ebce-2fe8-4a38-9862-8faa2e723df9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.549009 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:05:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85109e1d-3e21-4ffd-8813-fa24b53a2320 x-openstack-request-id: req-85109e1d-3e21-4ffd-8813-fa24b53a2320 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:05:28.549330 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:05:28.549588 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-85109e1d-3e21-4ffd-8813-fa24b53a2320 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:05:28.549985 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'code': 200} Jan 05 15:05:28.562575 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d4a4ebce-2fe8-4a38-9862-8faa2e723df9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.769818 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d4a4ebce-2fe8-4a38-9862-8faa2e723df9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.772542 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d4a4ebce-2fe8-4a38-9862-8faa2e723df9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:28.780412 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d4a4ebce-2fe8-4a38-9862-8faa2e723df9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/93cf9114-46da-4d77-8e9e-dda0c5b575f3 HTTP/1.1" status: 204 len: 168 time: 0.3494973 Jan 05 15:05:28.807772 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a4ebce-2fe8-4a38-9862-8faa2e723df9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93cf9114-46da-4d77-8e9e-dda0c5b575f3,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:29.167143 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37f366b-6dc4-4e16-9561-10671d093a89 req-d0a8a5f7-2ae9-409a-84ae-7069287411ac tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:29.168945 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c37f366b-6dc4-4e16-9561-10671d093a89 req-d0a8a5f7-2ae9-409a-84ae-7069287411ac tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0598042 Jan 05 15:05:29.224259 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c37f366b-6dc4-4e16-9561-10671d093a89 req-ee271fbf-b4e6-4229-addc-bb0f2b421019 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493722 Jan 05 15:05:29.787107 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7760560-b090-4cb0-bc65-33aac863e89c req-c60cc4b8-3ee9-4fb6-85d6-4d9a4ece4afa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:29.789269 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b7760560-b090-4cb0-bc65-33aac863e89c req-c60cc4b8-3ee9-4fb6-85d6-4d9a4ece4afa tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0486417 Jan 05 15:05:29.835022 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b7760560-b090-4cb0-bc65-33aac863e89c req-0d13bbe0-6b69-4c90-8aec-cb25ca09b488 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0396886 Jan 05 15:05:30.013361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49628) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:30.074409 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c053484a-dfd7-452a-88af-453b61af766d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c9dbadb18d1c4e888fda9d242ffdaf05&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0575192 Jan 05 15:05:30.074856 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49630) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:30.142912 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9b5d88c9-1737-45b1-b596-ea899d840638 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:30.167742 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9b5d88c9-1737-45b1-b596-ea899d840638 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:30.312305 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9b5d88c9-1737-45b1-b596-ea899d840638 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:30.320706 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9b5d88c9-1737-45b1-b596-ea899d840638 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:30.320706 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9b5d88c9-1737-45b1-b596-ea899d840638 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/54c9dc46-fcad-408e-a03c-c0c308d04e48 HTTP/1.1" status: 204 len: 168 time: 0.2425268 Jan 05 15:05:30.333007 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b5d88c9-1737-45b1-b596-ea899d840638 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54c9dc46-fcad-408e-a03c-c0c308d04e48,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:30.409882 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48c3df1-2a55-48ea-b964-9797c37c0f48 req-b2438f22-7a28-4070-b7e5-98e3873563d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:30.411417 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e48c3df1-2a55-48ea-b964-9797c37c0f48 req-b2438f22-7a28-4070-b7e5-98e3873563d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0954883 Jan 05 15:05:30.415162 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e75cacda-81f5-48eb-aa18-c28c3271850a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:30.493615 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e48c3df1-2a55-48ea-b964-9797c37c0f48 req-bf5d782e-599c-4d6d-ae2f-697006306b08 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0694709 Jan 05 15:05:30.984412 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19a04b5-f580-477a-bc62-2d63f77ea195 req-d4d61883-ba0f-42e8-af78-3e6c356c5cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:30.986039 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f19a04b5-f580-477a-bc62-2d63f77ea195 req-d4d61883-ba0f-42e8-af78-3e6c356c5cfc tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0531192 Jan 05 15:05:31.045609 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f19a04b5-f580-477a-bc62-2d63f77ea195 req-eafbf6c7-4c7c-4996-87f2-8c744fab4d1d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0515461 Jan 05 15:05:31.628457 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 req-e8e9dcbf-793f-49f2-aa2c-413a3e255db6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:31.630099 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 req-e8e9dcbf-793f-49f2-aa2c-413a3e255db6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0538666 Jan 05 15:05:31.715140 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-06b57507-85f9-4f27-b117-1cb7a601c6c9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:31.716682 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-06b57507-85f9-4f27-b117-1cb7a601c6c9 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0856881 Jan 05 15:05:31.721734 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-80fbbbb9-8b0a-412b-b7a5-fe59b0797ea0 req-393eb6ff-9dfc-4e9d-bdc4-3113eceaf403 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0822294 Jan 05 15:05:31.825155 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Deleting port 370464b7-853e-4daf-92d9-8ffcbe014202 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:31.825381 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:31.867782 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:31.936041 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] For port 370464b7-853e-4daf-92d9-8ffcbe014202, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=370464b7-853e-4daf-92d9-8ffcbe014202,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:31.936443 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:32.134999 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:32.135490 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:32.166085 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Floating IP 25ce5b32-e110-4764-88ef-cf1aec671947 disassociated. External IP: 172.37.2.22, port: 370464b7-853e-4daf-92d9-8ffcbe014202. Jan 05 15:05:32.166085 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling delete_port for 370464b7-853e-4daf-92d9-8ffcbe014202 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:32.208884 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1e40ce-47aa-4a74-be3c-243fa5024890 req-e8b8a103-8965-4d6e-8fb8-dfabda1a673f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:32.217697 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2f1e40ce-47aa-4a74-be3c-243fa5024890 req-e8b8a103-8965-4d6e-8fb8-dfabda1a673f tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 946 time: 0.0752609 Jan 05 15:05:32.297379 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2f1e40ce-47aa-4a74-be3c-243fa5024890 req-d063d90c-4957-42b2-a92b-598f3cbbf440 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups?id=c199b6c6-b8e5-4563-8702-fc7592cfef5d&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0749042 Jan 05 15:05:32.384764 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:32.415794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event deleted for resources: {'Port': ['ID=370464b7-853e-4daf-92d9-8ffcbe014202,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:32.566579 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Router d3c49f70-ad09-435c-bdeb-024562318429 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:05:32.682570 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:05:32.695404 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] Sync routers for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:05:32.712979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:32.712979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:32.724837 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] No DVR routers for this DVR port 370464b7-853e-4daf-92d9-8ffcbe014202 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:32.728185 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:32.731954 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2b97c25e-b4cb-4514-ab28-bb2e8f653497 req-88f79c87-e2b6-4dcc-8f3f-58ef1defc11d tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.13 "DELETE /v2.0/ports/370464b7-853e-4daf-92d9-8ffcbe014202 HTTP/1.1" status: 204 len: 173 time: 1.0093303 Jan 05 15:05:32.732449 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'name': 'network-vif-deleted', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:05:32.734883 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ea2d4ff-f25a-44bd-b146-21e9a00d8dd4" -d '{"events": [{"server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "name": "network-vif-deleted", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:05:32.749668 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:32.813854 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:05:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94a91540-9bcf-44ea-a27a-adf090ebbe58 x-openstack-request-id: req-94a91540-9bcf-44ea-a27a-adf090ebbe58 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:05:32.814168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62d39a5b-dac1-4667-b829-53506cf0c62b", "name": "network-vif-deleted", "tag": "370464b7-853e-4daf-92d9-8ffcbe014202", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:05:32.814479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-94a91540-9bcf-44ea-a27a-adf090ebbe58 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:05:32.814816 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62d39a5b-dac1-4667-b829-53506cf0c62b', 'name': 'network-vif-deleted', 'tag': '370464b7-853e-4daf-92d9-8ffcbe014202', 'status': 'completed', 'code': 200} Jan 05 15:05:32.847450 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:32.886968 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 req-1239e371-8990-49d6-bd34-104d9a7cdb32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:32.889542 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 req-1239e371-8990-49d6-bd34-104d9a7cdb32 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0708086 Jan 05 15:05:32.943477 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-81cdfe84-13a5-4c76-b0ca-477f34797dc5 req-9a4ca6ef-d900-42b2-8d76-7a639516ec9d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476573 Jan 05 15:05:33.070429 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:33.099779 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] Checking router: d3c49f70-ad09-435c-bdeb-024562318429 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:05:33.109463 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:33.110106 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:33.221983 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:33.394219 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5d27bd71-e569-4341-a355-61e9c06dfcdb req-5c5a921a-268c-4370-8551-b776ec507bd2 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 210 time: 0.0368295 Jan 05 15:05:33.427383 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:33.459323 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9810327-1798-4bd9-bca4-4d2456b4dd15 None None] The sync data for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi is: [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T14:59:31Z', 'revision_number': 4, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '109db72b-debc-46ae-9b63-f8edec570b8e', 'name': '', 'network_id': 'fb7bcda7-5039-4d82-bf68-12c9acc8a744', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'mac_address': 'fa:16:3e:6f:b3:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_interface', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:30Z', 'updated_at': '2022-01-05T14:59:44Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'subnets': [{'id': 'fd51f09d-6379-4a7e-97a4-fafd6cf55180', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:05:33.695718 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6521a45-1fe0-434a-9081-752028675984 None None] New status for floating IP 25ce5b32-e110-4764-88ef-cf1aec671947: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:05:33.718231 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:34.103842 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 req-1457aa36-399f-469f-a579-f1256c49b0dd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:34.105429 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 req-1457aa36-399f-469f-a579-f1256c49b0dd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0516562 Jan 05 15:05:34.172217 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3a514ad1-a7d1-4bb7-afed-e3f79b85eb40 req-4d150b6b-5ce6-4a8d-a06d-d875385981dd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593147 Jan 05 15:05:34.409304 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:34.519470 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4b7e9c75-f099-4e13-82bc-0bfe92606167 req-03c1eb97-ed80-46b3-b4b9-25ada9758e3c tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/ports?device_id=62d39a5b-dac1-4667-b829-53506cf0c62b HTTP/1.1" status: 200 len: 210 time: 0.0397213 Jan 05 15:05:35.176980 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-f2f5f09c-c902-40a6-8173-256564093b4c service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0439763 Jan 05 15:05:35.254152 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-59d299f0-b827-4d9c-9d93-6a81a5553d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:35.255649 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-59d299f0-b827-4d9c-9d93-6a81a5553d9b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1098 time: 0.0449491 Jan 05 15:05:35.323974 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af req-d1f91a5e-1a2f-474f-8c7a-4765cd94b278 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:35.326406 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af req-d1f91a5e-1a2f-474f-8c7a-4765cd94b278 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0671813 Jan 05 15:05:35.393025 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a37ae6ae-5ab1-4e5f-ba9e-33a6f59207af req-9f1bfa6f-7b31-45e1-b7b8-3f9669ae2695 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0591004 Jan 05 15:05:35.400253 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-e1f922c1-ef56-4d94-919b-e09793beae94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:35.401943 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-e1f922c1-ef56-4d94-919b-e09793beae94 service neutron] 10.222.0.13 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 909 time: 0.1244504 Jan 05 15:05:35.472096 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-75db4d46-e0a7-4a64-b659-235d8d0f2bea service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 1001 time: 0.0619080 Jan 05 15:05:35.524318 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-09ec3fd5-228b-46b8-89ba-1f659d709e60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:35.526216 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-09ec3fd5-228b-46b8-89ba-1f659d709e60 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 200 len: 847 time: 0.0459566 Jan 05 15:05:35.587794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-5ca9bd54-27b8-4ae7-a3f6-d74f36e32bd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:35.587794 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-5ca9bd54-27b8-4ae7-a3f6-d74f36e32bd6 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=e5205e82-a517-4157-848a-78560d0d2806&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0558231 Jan 05 15:05:35.686185 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49664) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:35.692599 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-3fcaa50d-9302-4609-9922-341e58d6782c service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0956342 Jan 05 15:05:35.750187 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:35.775543 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:35.802135 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5658866e-52aa-4325-a622-e8cdcc0cf8d3 req-8200d5d3-50a8-486a-8e76-c24979e64513 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023896 Jan 05 15:05:35.906966 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:35.909824 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:35.911015 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /v2.0/security-groups/c199b6c6-b8e5-4563-8702-fc7592cfef5d HTTP/1.1" status: 204 len: 168 time: 0.2238023 Jan 05 15:05:35.914010 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49666) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:35.922256 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c199b6c6-b8e5-4563-8702-fc7592cfef5d,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:35.929371 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.929648 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.api.v2.resource [None req-d8023043-3cab-49f7-b0c8-4f0f0ffc3094 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] show failed (client error): The resource could not be found. Jan 05 15:05:35.929799 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.930085 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.930399 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.930739 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.931086 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.931464 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.931803 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.932132 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.932467 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.932795 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.933138 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.933529 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14932a1b-1c7e-4117-bda8-bd68cc051636 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:35.934519 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d8023043-3cab-49f7-b0c8-4f0f0ffc3094 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "GET /v2.0/security-groups/c199b6c6-b8e5-4563-8702-fc7592cfef5d HTTP/1.1" status: 404 len: 347 time: 0.0193422 Jan 05 15:05:35.935177 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49668) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:36.068813 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Deleting port 2895ea2e-220b-449b-a9a4-a92d89c7a6b0 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:36.069186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:36.145611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 370464b7-853e-4daf-92d9-8ffcbe014202 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:36.152211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:36.152660 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:36.168434 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 370464b7-853e-4daf-92d9-8ffcbe014202 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:36.168815 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 370464b7-853e-4daf-92d9-8ffcbe014202 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:36.169675 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Calling delete_port for 2895ea2e-220b-449b-a9a4-a92d89c7a6b0 owned by network:floatingip {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:36.398227 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:36.432221 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Pushing event deleted for resources: {'Port': ['ID=2895ea2e-220b-449b-a9a4-a92d89c7a6b0,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:36.464827 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.465297 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.465629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.465972 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.466317 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.466648 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.467013 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.467314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.467648 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.467979 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.468311 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.468637 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.468964 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:05:36.541638 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks [] for floatingip, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:36.544255 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:36.545466 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-559ca42e-f205-4556-8d33-0d11e426d129 tempest-AttachVolumeTestJSON-672351277 tempest-AttachVolumeTestJSON-672351277-project] 10.222.0.30 "DELETE /v2.0/floatingips/25ce5b32-e110-4764-88ef-cf1aec671947 HTTP/1.1" status: 204 len: 168 time: 0.6090894 Jan 05 15:05:36.566185 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c5bc06-e69a-4dcc-8c28-ab68af86098e req-adb6e4f6-2ece-4328-87ed-b006e783ca98 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:36.567628 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-31c5bc06-e69a-4dcc-8c28-ab68af86098e req-adb6e4f6-2ece-4328-87ed-b006e783ca98 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0924280 Jan 05 15:05:36.628269 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-31c5bc06-e69a-4dcc-8c28-ab68af86098e req-4a0596f4-f4b4-4219-af37-0a49c1098d52 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536449 Jan 05 15:05:36.968175 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:05:37.778983 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f19c31-e93e-4f6d-857a-61fe64407459 req-403f006f-f378-4ef9-83de-f2cae6340043 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:37.780472 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b8f19c31-e93e-4f6d-857a-61fe64407459 req-403f006f-f378-4ef9-83de-f2cae6340043 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0578661 Jan 05 15:05:37.834237 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b8f19c31-e93e-4f6d-857a-61fe64407459 req-c61e30b2-446b-44b7-994d-7409f1b990bd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477681 Jan 05 15:05:38.954747 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771497a4-8449-4657-9bc2-716b332cd461 req-9261a2f5-c7a4-444e-ac31-6fb1ba3110b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:38.956188 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-771497a4-8449-4657-9bc2-716b332cd461 req-9261a2f5-c7a4-444e-ac31-6fb1ba3110b1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0484531 Jan 05 15:05:39.007997 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-771497a4-8449-4657-9bc2-716b332cd461 req-3f3c8e46-1c75-432c-a1a4-7879c38c0bcc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462046 Jan 05 15:05:39.058140 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dedfce7-02c2-4163-92a1-936835594481 req-eae85c68-c36e-4d11-b6da-4a0868d6b479 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:39.059721 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dedfce7-02c2-4163-92a1-936835594481 req-eae85c68-c36e-4d11-b6da-4a0868d6b479 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1098 time: 0.0398142 Jan 05 15:05:39.145925 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dedfce7-02c2-4163-92a1-936835594481 req-273af41f-89d2-47c8-b6a2-9faf13191cbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:39.147261 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dedfce7-02c2-4163-92a1-936835594481 req-273af41f-89d2-47c8-b6a2-9faf13191cbc service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.0811546 Jan 05 15:05:39.215767 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dedfce7-02c2-4163-92a1-936835594481 req-73fc3753-6d4a-4417-8413-c5eaf6df885a service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843 HTTP/1.1" status: 200 len: 1001 time: 0.0609622 Jan 05 15:05:39.261942 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dedfce7-02c2-4163-92a1-936835594481 req-69a558f1-a188-465b-9286-de2ec2407b1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:39.263304 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dedfce7-02c2-4163-92a1-936835594481 req-69a558f1-a188-465b-9286-de2ec2407b1b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0421438 Jan 05 15:05:39.306420 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dedfce7-02c2-4163-92a1-936835594481 req-a0e6a456-9830-40fa-912a-75c23e9950a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:39.307887 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dedfce7-02c2-4163-92a1-936835594481 req-a0e6a456-9830-40fa-912a-75c23e9950a9 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383735 Jan 05 15:05:39.400698 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dedfce7-02c2-4163-92a1-936835594481 req-bb9f8b0e-12eb-4196-8a7b-02e0add75d37 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868516 Jan 05 15:05:39.485501 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1dedfce7-02c2-4163-92a1-936835594481 req-1d57ff2a-4529-4a1c-8946-65227bd5f347 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0794370 Jan 05 15:05:40.123956 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 req-7da21df9-47fa-46fc-9f75-6255b9ba7663 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:40.125431 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 req-7da21df9-47fa-46fc-9f75-6255b9ba7663 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0476806 Jan 05 15:05:40.172307 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e01fd278-6b99-40fe-b5f3-60fb2fcad705 req-c20270a4-038c-48af-a100-0c9cac93694b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410316 Jan 05 15:05:41.024720 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49718) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:41.305639 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f85610d-b301-462e-a280-770ace480a19 req-4ee6dbed-a709-42f7-90ca-edd0ad14624c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:41.307126 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f85610d-b301-462e-a280-770ace480a19 req-4ee6dbed-a709-42f7-90ca-edd0ad14624c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0580451 Jan 05 15:05:41.352646 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f85610d-b301-462e-a280-770ace480a19 req-864f4e16-ed81-4646-ae7a-324e10839e65 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398412 Jan 05 15:05:41.793682 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:42.027587 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Deleting port 109db72b-debc-46ae-9b63-f8edec570b8e {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:42.027923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:42.102490 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] For port 109db72b-debc-46ae-9b63-f8edec570b8e, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=109db72b-debc-46ae-9b63-f8edec570b8e,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:42.103052 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:42.115149 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Calling delete_port for 109db72b-debc-46ae-9b63-f8edec570b8e owned by network:router_interface {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:42.160303 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:42.357638 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:42.363618 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:42.382058 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:05:42.384747 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a14277fe-b79e-42c2-aabb-d69482648f7d" -d '{"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-unplugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:05:42.392949 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Pushing event deleted for resources: {'Port': ['ID=109db72b-debc-46ae-9b63-f8edec570b8e,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:42.399049 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:42.439413 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 05 Jan 2022 15:05:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 x-openstack-request-id: req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:05:42.447611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-unplugged", "status": "failed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843", "code": 422}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:05:42.447611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1f9682e2-b1bc-4ff5-85b2-92c5d5292f03 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:05:42.447611 dv-cinder-master-3-iscsi neutron-server[114656]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'code': 422} returned with failed status Jan 05 15:05:42.472296 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:42.527847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=8']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:42.550935 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b req-9ca23218-e2cd-477a-8ffc-644c8045784b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:42.552458 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b req-9ca23218-e2cd-477a-8ffc-644c8045784b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 945 time: 0.0993333 Jan 05 15:05:42.619507 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:42.646793 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49dab8b9-f7cc-4182-bb21-2ed0fc75647b req-aabae170-c596-42a5-beee-edeb6ad5efe3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0654988 Jan 05 15:05:42.849131 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Router d3c49f70-ad09-435c-bdeb-024562318429 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:05:42.954985 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:05:42.961352 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-985ab8b9-a5bf-4210-95e1-b7fd13b1f214 admin admin] 10.222.0.30 "PUT /v2.0/routers/d3c49f70-ad09-435c-bdeb-024562318429/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9342527 Jan 05 15:05:42.963169 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49736) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:42.966109 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] Sync routers for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:05:42.978034 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:42.978669 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:43.066591 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks [] for router, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.080893 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:43.168543 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.259032 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131'}], 'enable_snat': True}, 'gw_port_id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T15:05:42Z', 'revision_number': 5, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port': {'id': '4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:43.285801 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] Checking router: d3c49f70-ad09-435c-bdeb-024562318429 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:05:43.295137 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] Routers {'d3c49f70-ad09-435c-bdeb-024562318429'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:05:43.295579 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Deleting port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:43.295792 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:05:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['d3c49f70-ad09-435c-bdeb-024562318429'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:43.295988 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.379837 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] For port 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:43.380230 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.384304 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] Set router d3c49f70-ad09-435c-bdeb-024562318429 gateway port host: None {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:05:43.396368 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Calling delete_port for 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 owned by network:router_gateway {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:43.438020 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T15:05:43Z', 'revision_number': 6, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:43.466806 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3ebd78e-7439-4601-937d-8d771be2f73a None None] The sync data for ids ['d3c49f70-ad09-435c-bdeb-024562318429'] in dv-cinder-master-3-iscsi is: [{'id': 'd3c49f70-ad09-435c-bdeb-024562318429', 'name': 'tempest-AttachVolumeTestJSON-337172709-router', 'tenant_id': '715006ffd8ba4e5b963511ec759ae152', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:25Z', 'updated_at': '2022-01-05T15:05:43Z', 'revision_number': 6, 'project_id': '715006ffd8ba4e5b963511ec759ae152', 'gw_port_host': None}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:05:43.666573 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.697651 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Pushing event deleted for resources: {'Port': ['ID=4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:43.750455 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.844224 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.846615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.990011 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.990639 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d3c49f70-ad09-435c-bdeb-024562318429 {{(pid=114655) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:05:43.996783 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:43.997996 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-ab57f9d0-bcc1-49ed-96d4-bababbccfd12 admin admin] 10.222.0.30 "DELETE /v2.0/routers/d3c49f70-ad09-435c-bdeb-024562318429 HTTP/1.1" status: 204 len: 168 time: 1.0335333 Jan 05 15:05:44.000660 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49748) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:44.048346 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_v2 [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] Deleting subnet fd51f09d-6379-4a7e-97a4-fafd6cf55180 {{(pid=114654) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:05:44.051422 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.084782 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8770652'] for subnet, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.283870 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 109db72b-debc-46ae-9b63-f8edec570b8e no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:44.309474 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 109db72b-debc-46ae-9b63-f8edec570b8e {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:44.309961 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 109db72b-debc-46ae-9b63-f8edec570b8e not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:44.310627 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:44.330946 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:44.334070 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ac0b8a7-7df3-433c-b6b6-a6ce3a59ab29 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:44.456873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.620979 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8855717', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8833888'] for subnet, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.646925 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fd51f09d-6379-4a7e-97a4-fafd6cf55180,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:44.650573 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.654293 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-07bfd703-5048-4b4d-914e-88ae134c439f admin admin] 10.222.0.30 "DELETE /v2.0/subnets/fd51f09d-6379-4a7e-97a4-fafd6cf55180 HTTP/1.1" status: 204 len: 168 time: 0.6517322 Jan 05 15:05:44.657261 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6504ec2a-a0ed-4459-a85a-96d1c9354297 None None] Network fb7bcda7-5039-4d82-bf68-12c9acc8a744 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:05:44.659867 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49754) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:44.731837 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.790895 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Deleting port ace48ad1-7011-475a-9bbb-f8af2f228cfd {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:44.791346 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.809140 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [req-2065defa-96f2-4583-b2d7-bbb7ccb38a2d req-8516ad7f-295e-417d-9eab-a77ba1036d99 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 15:05:44.810693 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2065defa-96f2-4583-b2d7-bbb7ccb38a2d req-8516ad7f-295e-417d-9eab-a77ba1036d99 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0646172 Jan 05 15:05:44.846353 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] DHCP port deletion for fb7bcda7-5039-4d82-bf68-12c9acc8a744 request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:05:44.858782 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] For port ace48ad1-7011-475a-9bbb-f8af2f228cfd, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ace48ad1-7011-475a-9bbb-f8af2f228cfd,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:44.859155 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.872841 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Calling delete_port for ace48ad1-7011-475a-9bbb-f8af2f228cfd owned by network:dhcp {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:44.895420 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] Deleting port ace48ad1-7011-475a-9bbb-f8af2f228cfd {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:05:44.895794 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.957593 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] For port ace48ad1-7011-475a-9bbb-f8af2f228cfd, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ace48ad1-7011-475a-9bbb-f8af2f228cfd,segment=NetworkSegment(07f0d075-8e78-40da-9903-e50c29fe982c),segment_id=07f0d075-8e78-40da-9903-e50c29fe982c)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:05:44.957992 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:44.969878 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] Calling delete_port for ace48ad1-7011-475a-9bbb-f8af2f228cfd owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:05:45.039647 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.051055 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.071864 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Pushing event deleted for resources: {'Port': ['ID=ace48ad1-7011-475a-9bbb-f8af2f228cfd,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:45.076115 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] Pushing event deleted for resources: {'Port': ['ID=ace48ad1-7011-475a-9bbb-f8af2f228cfd,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:45.083113 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28e40976-7915-4b60-858d-f5bf5fb66a39 None None] No DVR routers for this DVR port ace48ad1-7011-475a-9bbb-f8af2f228cfd on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:45.098564 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] No DVR routers for this DVR port ace48ad1-7011-475a-9bbb-f8af2f228cfd on host dv-cinder-master-3-iscsi {{(pid=114655) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:05:45.187637 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.203574 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 req-bc615df6-69cb-48bf-8775-2f6b216dcb1f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:45.203574 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 req-bc615df6-69cb-48bf-8775-2f6b216dcb1f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.1285143 Jan 05 15:05:45.229432 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fb7bcda7-5039-4d82-bf68-12c9acc8a744']}} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:45.242510 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '07f0d075-8e78-40da-9903-e50c29fe982c') {'for_net_delete': True} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:45.242803 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '07f0d075-8e78-40da-9903-e50c29fe982c') {} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:05:45.258061 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4701328'] for segment, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.280786 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2d41c9d0-634c-4a6e-8319-4a4fb51af588 req-d9171343-6ba2-40c8-acf1-fbd0d345794e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0742204 Jan 05 15:05:45.281620 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.287582 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Releasing vlan 146 on physical network physnet1 to pool {{(pid=114655) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:05:45.287910 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4698958'] for segment, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: Traceback (most recent call last): Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: timer() Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: cb(*args, **kw) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: return func(*args, **kwargs) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: self._notify() Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: self.callback(batched_events) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: event.method(event) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: return f(self, *a, **k) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: return self._get(url).json() Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: return self.request(url, 'GET', **kwargs) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:05:45.290090 dv-cinder-master-3-iscsi neutron-server[114655]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:05:45.438822 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.448937 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.452138 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] 10.222.0.30 "DELETE /v2.0/networks/fb7bcda7-5039-4d82-bf68-12c9acc8a744 HTTP/1.1" status: 204 len: 168 time: 0.7912433 Jan 05 15:05:45.465772 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a16f37d-4032-447b-b95d-b9876c356e52 admin admin] Pushing event deleted for resources: {'Network': ['ID=fb7bcda7-5039-4d82-bf68-12c9acc8a744,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:45.479618 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-d3a9912e-ccfb-400c-99c2-152e4f2c2c0a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0652714 Jan 05 15:05:45.858747 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49784) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:45.896919 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-62b574f4-78d3-4edb-9edc-14aff0a8ebea admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=715006ffd8ba4e5b963511ec759ae152&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0370648 Jan 05 15:05:45.899861 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49786) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:45.944585 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02247991-0e6f-466e-b59b-6ebb0b382a0c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:45.967842 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02247991-0e6f-466e-b59b-6ebb0b382a0c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:46.091336 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ace48ad1-7011-475a-9bbb-f8af2f228cfd no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:46.112788 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02247991-0e6f-466e-b59b-6ebb0b382a0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:46.117853 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-02247991-0e6f-466e-b59b-6ebb0b382a0c admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:46.118642 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: ace48ad1-7011-475a-9bbb-f8af2f228cfd {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:05:46.119057 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ace48ad1-7011-475a-9bbb-f8af2f228cfd not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:05:46.122217 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-02247991-0e6f-466e-b59b-6ebb0b382a0c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/847274a0-8363-42b6-acf6-390991642d01 HTTP/1.1" status: 204 len: 168 time: 0.2212760 Jan 05 15:05:46.131495 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02247991-0e6f-466e-b59b-6ebb0b382a0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=847274a0-8363-42b6-acf6-390991642d01,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:46.192494 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:05:46.402493 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 req-45970295-1f37-49ee-ab69-4680788756fd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:46.403956 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 req-45970295-1f37-49ee-ab69-4680788756fd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0514445 Jan 05 15:05:46.452175 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bfb5e96e-858d-4fac-99c0-aa90c20cdaf6 req-ff272e31-feee-464b-9e70-a4ff1ab52099 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425191 Jan 05 15:05:47.185139 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 49810) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:47.188542 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-17fb44c1-87c5-445e-b2d0-2ef69ddc38c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:47.190039 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-17fb44c1-87c5-445e-b2d0-2ef69ddc38c5 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f&tenant_id=f4a45a70c5d046238abaad07fbe529e9 HTTP/1.1" status: 200 len: 1096 time: 0.0393779 Jan 05 15:05:47.259479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-14e3ad7c-5619-4e38-b2de-2254f873f8e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:47.261013 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-14e3ad7c-5619-4e38-b2de-2254f873f8e0 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1096 time: 0.0392451 Jan 05 15:05:47.286599 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-580423270-network', 'tenant_id': '97821d0c0c79446abba323f103c8244a'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:05:47.350168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-256dbffb-45b2-49d4-90ca-bb81789b97df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:47.351667 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-256dbffb-45b2-49d4-90ca-bb81789b97df service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.0853274 Jan 05 15:05:47.389930 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Made reservation on behalf of 97821d0c0c79446abba323f103c8244a for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:05:47.392378 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.401493 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.418005 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-792d0e60-67cb-4ccf-9511-0761095fae6e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843 HTTP/1.1" status: 200 len: 999 time: 0.0609956 Jan 05 15:05:47.470403 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-2dbdb48e-417b-4300-bb1d-db39afc77379 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:47.471867 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-2dbdb48e-417b-4300-bb1d-db39afc77379 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0482383 Jan 05 15:05:47.476563 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.520413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-eca9b3ad-d37d-40f0-a039-81e628deda5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:47.521962 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-eca9b3ad-d37d-40f0-a039-81e628deda5a service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421824 Jan 05 15:05:47.558408 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.591526 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 111} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:05:47.599200 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c978cfc7-bd69-439c-b1cf-84351cad64e7,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:47.611035 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abdf66bb-7fde-4b33-8295-06099d09b19c req-eb572ce3-9788-485f-8d95-7eb6aab074f9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:47.612489 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-abdf66bb-7fde-4b33-8295-06099d09b19c req-eb572ce3-9788-485f-8d95-7eb6aab074f9 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0834818 Jan 05 15:05:47.615491 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-f8dcb2dd-28ab-479d-b279-98de2bce69f8 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861351 Jan 05 15:05:47.616612 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.616958 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Added segment 88c3102d-b3ce-4ec1-8d0d-61de3749ce55 of type vlan for network 15d9f439-989e-49bd-a540-259f7f374d29 Jan 05 15:05:47.677593 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.701247 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-abdf66bb-7fde-4b33-8295-06099d09b19c req-587a7296-3acb-4aa3-8c08-1ba4e7d2190d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821836 Jan 05 15:05:47.720827 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-db6e1832-0e73-477f-99a4-9a201cfc63aa service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0983472 Jan 05 15:05:47.775522 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.776428 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:47.777116 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:47.844782 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] Pushing event updated for resources: {'Network': ['ID=15d9f439-989e-49bd-a540-259f7f374d29,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:47.854563 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 15d9f439-989e-49bd-a540-259f7f374d29 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:05:47.863513 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-01bdacb1-43f1-49f0-9d3b-b8bb3b420981 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6772006 Jan 05 15:05:47.867229 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 49820) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:05:47.872355 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Request body: {'subnet': {'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-580423270-subnet', 'tenant_id': '97821d0c0c79446abba323f103c8244a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:05:47.952284 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Made reservation on behalf of 97821d0c0c79446abba323f103c8244a for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:05:47.954766 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8833947'] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:48.192554 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8855778', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8833897'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:48.248799 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Pushing event updated for resources: {'Subnet': ['ID=9561926f-aba3-4028-bd06-409215177cc6,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:48.259211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Checking segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:05:48.259554 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Network hostable DHCP agents. Network: 15d9f439-989e-49bd-a540-259f7f374d29, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:05:48.352291 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Network 15d9f439-989e-49bd-a540-259f7f374d29 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:05:48.432335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 15d9f439-989e-49bd-a540-259f7f374d29) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:05:48.437952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:48.438578 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:48.448718 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f081fc3f-4e28-4c16-a6bf-c8b2057bbb37 None None] Network 15d9f439-989e-49bd-a540-259f7f374d29 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:05:48.545685 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-10f75ded-f8c6-42f4-8275-4edefaf52eed admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6771493 Jan 05 15:05:48.567268 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dcade2d-cc50-4eae-b02f-cc7fcdc2cf09 None None] Network 15d9f439-989e-49bd-a540-259f7f374d29 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:05:48.858814 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6f2927-f50c-4d4d-8973-49f9abec627c req-d9cc28d9-15a7-4906-8eeb-5ea0f6644997 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:48.860382 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-aa6f2927-f50c-4d4d-8973-49f9abec627c req-d9cc28d9-15a7-4906-8eeb-5ea0f6644997 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0705109 Jan 05 15:05:48.916795 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-aa6f2927-f50c-4d4d-8973-49f9abec627c req-8bb68d6b-0bb3-47cf-9d23-bf2d206ddb6b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509443 Jan 05 15:05:49.146422 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-cb8fa670-d220-4eac-83c8-8e424e88b183 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:49.154075 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-cb8fa670-d220-4eac-83c8-8e424e88b183 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.1166906 Jan 05 15:05:49.164820 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-94bd4d0e-691a-44b6-a19a-f480241e4702 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/quotas/97821d0c0c79446abba323f103c8244a HTTP/1.1" status: 200 len: 375 time: 0.0096269 Jan 05 15:05:49.202186 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-bab1dd94-fc3b-4f7b-a92b-dd71bb3f4495 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0318701 Jan 05 15:05:49.344912 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-b8fc409a-eed3-4842-a538-e1ce1c64babf service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361542 Jan 05 15:05:49.441109 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-aaadebe2-1986-4475-844d-5b6037c0a186 service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0930271 Jan 05 15:05:49.709725 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f79132f5-18ef-4218-8cd8-0de755e1565f req-774bc5bd-387a-477f-956e-9889dd50fbb0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0328388 Jan 05 15:05:50.074640 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf0b2c1-ebf2-418c-bf25-d01bf035235b req-ecd0ba68-b577-4f5c-89bc-5ff17aeaaf2d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:50.076561 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-caf0b2c1-ebf2-418c-bf25-d01bf035235b req-ecd0ba68-b577-4f5c-89bc-5ff17aeaaf2d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0696414 Jan 05 15:05:50.133435 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-caf0b2c1-ebf2-418c-bf25-d01bf035235b req-da08e9cc-35f6-4709-95ee-a2221d7409fd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512497 Jan 05 15:05:50.822164 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ac7ebb0d-a05f-40d0-9f2d-2a4a9fda335a req-b66aba0f-4c9e-45f8-8d1c-e2d7e5970c4e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0455394 Jan 05 15:05:51.260933 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2feb34e9-7ce3-449d-8dee-6049431d802b req-74080fc9-cdf6-402d-9982-3da0657a4ae6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:51.262576 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2feb34e9-7ce3-449d-8dee-6049431d802b req-74080fc9-cdf6-402d-9982-3da0657a4ae6 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0537894 Jan 05 15:05:51.326311 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2feb34e9-7ce3-449d-8dee-6049431d802b req-fa0518b8-49a4-40e1-8b8f-a1789a76e2b3 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566523 Jan 05 15:05:51.918943 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3cabb11a-9cb6-4e45-88d4-b5fb4a8e7796 req-515fe52f-f96b-4d53-baa4-6356417f24c2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0277209 Jan 05 15:05:52.464604 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d81f21-7fd1-4207-9882-f84056d714e6 req-f1db3d4d-5eb7-4230-b913-e7dcfab45f91 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:52.466337 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-22d81f21-7fd1-4207-9882-f84056d714e6 req-f1db3d4d-5eb7-4230-b913-e7dcfab45f91 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0623696 Jan 05 15:05:52.526846 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-22d81f21-7fd1-4207-9882-f84056d714e6 req-fc5838d8-b068-41f1-880b-9155ad99ac9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542269 Jan 05 15:05:53.016573 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c4265ec1-a23f-4c3e-bed8-8d5dd502aef3 req-463a6795-0e81-4dd0-a86f-dd0d62d8bf15 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0313232 Jan 05 15:05:53.652434 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df req-7f2e6e4b-296d-4536-9c31-89610035f280 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:53.654211 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df req-7f2e6e4b-296d-4536-9c31-89610035f280 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0528777 Jan 05 15:05:53.716383 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fed05e68-8c01-4fcb-92eb-f003b1c6a0df req-3217ec67-8d1e-4e24-99de-d61ecdabbfab tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563836 Jan 05 15:05:54.126479 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9b73cfd7-b312-464b-974a-89159789719e req-700efed6-97e1-4e3d-932c-dfbe90fd62cd tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0301709 Jan 05 15:05:54.852113 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 req-0f56cd6e-08a9-483a-aeba-8c9dbcb8c176 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:54.854478 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 req-0f56cd6e-08a9-483a-aeba-8c9dbcb8c176 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0588818 Jan 05 15:05:54.912563 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9a0884ba-ff25-4a3c-98e0-ab7fb39a6d59 req-32027a05-4781-4ebb-a947-aa655457c22e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519013 Jan 05 15:05:55.229702 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2c8e6be7-1708-4ea8-bd35-9f692cc70e99 req-5e87ab10-f7ec-4bd3-a0d0-f1f2243c605f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0307746 Jan 05 15:05:56.051725 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c08beb-88a1-4575-b7ec-bcfbc689d629 req-c16696db-e158-42ed-be0c-f904fd98efaf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:56.053446 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-97c08beb-88a1-4575-b7ec-bcfbc689d629 req-c16696db-e158-42ed-be0c-f904fd98efaf tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0527279 Jan 05 15:05:56.109046 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-97c08beb-88a1-4575-b7ec-bcfbc689d629 req-1f84fc9c-7e6c-43b8-9aea-7aa9121352d1 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497191 Jan 05 15:05:56.320914 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ee903717-9a26-418f-a326-e3cdb63a8208 req-fcac91b8-f8ae-4996-8282-a538bda8ebe8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0256474 Jan 05 15:05:57.233687 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ff655e-c709-42b2-8227-dd853660e909 req-f9041fe8-3208-4411-a617-ff816890add5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:57.235197 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-67ff655e-c709-42b2-8227-dd853660e909 req-f9041fe8-3208-4411-a617-ff816890add5 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0484397 Jan 05 15:05:57.281111 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-67ff655e-c709-42b2-8227-dd853660e909 req-67383f3b-3ad4-41fc-a223-44e5d6e957eb tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401742 Jan 05 15:05:57.412597 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dee4df59-a535-4de7-a459-6b0104885e74 req-8bcc96c1-0475-42af-a516-d7ac0d43fd83 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0259137 Jan 05 15:05:57.968775 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-bdef164a-d376-4a8a-bf13-46d94e88c559 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:57.970242 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-bdef164a-d376-4a8a-bf13-46d94e88c559 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.0979865 Jan 05 15:05:57.999304 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Request body: {'port': {'device_id': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'admin_state_up': True, 'tenant_id': '97821d0c0c79446abba323f103c8244a'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:05:58.237889 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-74fdedd2-cff8-4ec1-9314-adef1bcfd494 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:58.238501 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Made reservation on behalf of 97821d0c0c79446abba323f103c8244a for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:05:58.241457 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:58.370316 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Allocated IP 172.20.0.7 (15d9f439-989e-49bd-a540-259f7f374d29/9561926f-aba3-4028-bd06-409215177cc6/906a8d4e-ebf8-4e84-9c63-6111c3e36d6b) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:05:58.408428 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 req-76918a80-ab03-4d4d-8b1a-491d15e7d619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:58.409959 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 req-76918a80-ab03-4d4d-8b1a-491d15e7d619 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0576818 Jan 05 15:05:58.457908 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-51ab9eb2-ff96-4d08-b4bf-73cb867d2fa0 req-c8fa3de1-4817-4cba-9efb-0c0f1ac28727 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415936 Jan 05 15:05:58.517606 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4560ee88-4a02-4764-b849-1fc8126a822a req-d0dc26e3-b44c-4308-932e-e4fdac8533ce tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0355351 Jan 05 15:05:58.538858 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:58.632034 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:58.674346 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Network 15d9f439-989e-49bd-a540-259f7f374d29 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:05:58.677651 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:05:58.682455 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:05:58.691444 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event updated for resources: {'Port': ['ID=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:58.736050 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:58.736685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:58.811224 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-1f1e7fad-3b3c-4c28-8185-631846b452d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8154812 Jan 05 15:05:58.827115 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Request body: {'port': {'device_id': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:05:58.880623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:59.129048 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:05:59.136399 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:59.147636 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Transition to ACTIVE for port object 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:05:59.249047 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:59.298834 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Pushing event updated for resources: {'Port': ['ID=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:59.364527 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Attempting to bind port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:05:59.364952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Attempting to bind port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:05:59.365322 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Attempting to bind port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:05:59.370430 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b on network 15d9f439-989e-49bd-a540-259f7f374d29 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:05:59.370755 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Attempting to bind port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:05:59.375473 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 5, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:05:59.375865 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Checking segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:05:59.376251 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Bound using segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:05:59.376719 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Bound port: 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:05:59.377150 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:59.440678 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] For port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:05:59.443759 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] For port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:05:59.529850 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:59.562579 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:59.563301 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:05:59.564727 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] 10.222.0.13 "PUT /v2.0/ports/906a8d4e-ebf8-4e84-9c63-6111c3e36d6b HTTP/1.1" status: 200 len: 1093 time: 0.7415006 Jan 05 15:05:59.565199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'tag': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:05:59.567479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c9bb961-3d75-4158-aec0-742dcf3756b7" -d '{"events": [{"name": "network-changed", "server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:05:59.580561 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1151795-3f7a-43f0-bc49-1247f7b16c38 req-6b998261-1fe9-4ebe-bd53-bc7e249bd257 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:59.582130 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a1151795-3f7a-43f0-bc49-1247f7b16c38 req-6b998261-1fe9-4ebe-bd53-bc7e249bd257 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 943 time: 0.0504127 Jan 05 15:05:59.609486 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2408db2c-177a-40da-8e56-1172e82b02ab service neutron] Pushing event updated for resources: {'Port': ['ID=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:05:59.633853 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a1151795-3f7a-43f0-bc49-1247f7b16c38 req-a1e00a0c-3bfd-4559-8674-966b87838308 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445826 Jan 05 15:05:59.650413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb req-400ed464-794b-43bc-850b-a94ec7c16aeb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:59.651933 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb req-400ed464-794b-43bc-850b-a94ec7c16aeb tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 943 time: 0.0556345 Jan 05 15:05:59.685743 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:05:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2daf9974-d8a3-4979-81dd-843c8eedbf77 x-openstack-request-id: req-2daf9974-d8a3-4979-81dd-843c8eedbf77 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:05:59.686032 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:05:59.686281 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2daf9974-d8a3-4979-81dd-843c8eedbf77 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:05:59.686692 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'tag': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', 'status': 'completed', 'code': 200} Jan 05 15:05:59.710295 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d3bf6304-9fd7-4ff2-a114-09e19a0f19eb req-f1e7a0ca-8c4c-4f20-beb7-828d64ee8a75 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508235 Jan 05 15:05:59.764824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-472c840a-e46e-4386-a0c4-a2e18aa423a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:59.766378 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-472c840a-e46e-4386-a0c4-a2e18aa423a1 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 1096 time: 0.0415392 Jan 05 15:05:59.867580 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-df21423e-17b8-4fae-bd60-efe42c0bdcc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:59.869721 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-df21423e-17b8-4fae-bd60-efe42c0bdcc4 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=97821d0c0c79446abba323f103c8244a&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0897031 Jan 05 15:05:59.964798 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-43a2d544-0afc-4010-8fac-5f4ed613c76e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:05:59.966211 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1c9bb961-3d75-4158-aec0-742dcf3756b7 req-43a2d544-0afc-4010-8fac-5f4ed613c76e service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0885022 Jan 05 15:06:00.059157 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-24919e3c-b575-46f3-aa60-9211760f4a90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:00.060661 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-24919e3c-b575-46f3-aa60-9211760f4a90 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 1096 time: 0.0407422 Jan 05 15:06:00.110448 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-67f863f6-4082-42a2-b5e3-936a6bacf59d service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b HTTP/1.1" status: 200 len: 217 time: 0.0372660 Jan 05 15:06:00.157024 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-53e452f9-bbdb-4f89-bc9f-10683494d6eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:00.158509 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-53e452f9-bbdb-4f89-bc9f-10683494d6eb service neutron] 10.222.0.13 "GET /v2.0/subnets?id=9561926f-aba3-4028-bd06-409215177cc6 HTTP/1.1" status: 200 len: 854 time: 0.0430400 Jan 05 15:06:00.188344 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-20a933cb-bc2b-4213-95c1-f6b4d491b1a1 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=15d9f439-989e-49bd-a540-259f7f374d29&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242307 Jan 05 15:06:00.269128 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:06:00.273413 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-e56d86fd-17cc-4374-91c1-c65ac6f175e3 service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796783 Jan 05 15:06:00.365824 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-38cb3675-5dd2-4313-ab98-17485aeefd47 req-9bc7b759-a507-4e6a-bd46-28e7eaee3833 service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862236 Jan 05 15:06:00.370825 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:00.381617 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'port_id': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'mac_address': 'fa:16:3e:f0:40:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:06:00.422843 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:00.424550 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-527ee888-d39b-48d3-9cf8-cec9ee855f4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:00.435888 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d57813b-5531-41c7-8d8d-8b2fc393b843 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:06:00.454659 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:00.532510 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:00.581371 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=9']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:00.761436 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f7926e-f03a-4ab2-b7e9-dc77f787468b req-d2ed624c-1f1d-4868-b39e-ed22e6a1268e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:00.762925 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-72f7926e-f03a-4ab2-b7e9-dc77f787468b req-d2ed624c-1f1d-4868-b39e-ed22e6a1268e tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 944 time: 0.0556247 Jan 05 15:06:00.809393 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-72f7926e-f03a-4ab2-b7e9-dc77f787468b req-77f89251-a9e0-48da-9080-03b7bbaa83cc tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408340 Jan 05 15:06:00.826527 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e req-b015b813-5df4-4fad-91ea-cac64be98a2a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:00.828009 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e req-b015b813-5df4-4fad-91ea-cac64be98a2a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 943 time: 0.0499172 Jan 05 15:06:00.848140 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['0d57813b-5531-41c7-8d8d-8b2fc393b843'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:06:00.877868 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-92cbe96b-f5b9-49d9-8f35-2a05ef33701e req-5ddde12f-3298-411d-a250-39c3042428df tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443981 Jan 05 15:06:01.837343 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:01.928962 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d241c83c-7746-4563-813e-8d8f3b37c395 req-e3b1f017-ec54-4cf3-b74b-939e17a8ebe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:01.931117 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d241c83c-7746-4563-813e-8d8f3b37c395 req-e3b1f017-ec54-4cf3-b74b-939e17a8ebe8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 944 time: 0.0478363 Jan 05 15:06:01.977498 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d241c83c-7746-4563-813e-8d8f3b37c395 req-87b1eb8a-3cdc-47bc-8fe0-b89e4c83507f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404425 Jan 05 15:06:01.997869 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-929af0b4-3bd6-426e-a8d5-15baa1729316 req-c8e3a201-a1bd-44b9-b3a4-1fb58ee5a9f3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:01.999399 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-929af0b4-3bd6-426e-a8d5-15baa1729316 req-c8e3a201-a1bd-44b9-b3a4-1fb58ee5a9f3 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 943 time: 0.0541286 Jan 05 15:06:02.047210 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-929af0b4-3bd6-426e-a8d5-15baa1729316 req-06ec3260-bff1-42ff-bcc7-8c508847902f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423517 Jan 05 15:06:02.284450 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:06:02.330467 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 0d57813b-5531-41c7-8d8d-8b2fc393b843 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:06:02.330830 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:02.406063 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:02.427821 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:02.430124 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c37c7a2c-b902-4372-af87-e3d8be1b6267" -d '{"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:02.442772 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:02.469538 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df78a62e-92b4-4ad4-9668-ab228a73b386 x-openstack-request-id: req-df78a62e-92b4-4ad4-9668-ab228a73b386 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:02.469847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-plugged", "status": "completed", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:02.470105 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-df78a62e-92b4-4ad4-9668-ab228a73b386 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:02.470531 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'code': 200} Jan 05 15:06:02.528770 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:02.575492 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=10']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:02.751872 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:02.857570 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f757e993-df01-4683-9653-22addb86ba55 req-6b5fc5ab-c1f9-42b3-bff1-c8574d36a29e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:02.858963 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f757e993-df01-4683-9653-22addb86ba55 req-6b5fc5ab-c1f9-42b3-bff1-c8574d36a29e service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1099 time: 0.0403497 Jan 05 15:06:02.904172 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f757e993-df01-4683-9653-22addb86ba55 req-dd845865-9d8f-4ac6-ba17-9c6b4b0327fb service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388126 Jan 05 15:06:03.097679 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 req-f7e3232a-d164-4544-bf3a-7fa3840c006b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:03.099219 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 req-f7e3232a-d164-4544-bf3a-7fa3840c006b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0503852 Jan 05 15:06:03.150912 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3b21afeb-ede4-4a1f-9df5-e4c679b3daa8 req-e8f26a7c-2144-4a50-9a43-6be04cba9a27 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459347 Jan 05 15:06:03.162364 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c692210d-21f5-47b4-a27f-2e2f588880e5 req-2402f068-92e5-4512-8304-809cdaa37833 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:03.163834 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c692210d-21f5-47b4-a27f-2e2f588880e5 req-2402f068-92e5-4512-8304-809cdaa37833 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 943 time: 0.0500996 Jan 05 15:06:03.213020 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c692210d-21f5-47b4-a27f-2e2f588880e5 req-aa589c74-6856-4c2d-907f-c3be55b19199 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434737 Jan 05 15:06:03.574383 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:04.273142 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-839772d6-7904-4e0f-abdf-8658793afcb7 req-30dbbcc6-d0dc-438e-acdd-e43605fa5304 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:04.275244 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-839772d6-7904-4e0f-abdf-8658793afcb7 req-30dbbcc6-d0dc-438e-acdd-e43605fa5304 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0523362 Jan 05 15:06:04.300286 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:06:04.327007 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-839772d6-7904-4e0f-abdf-8658793afcb7 req-165ad0b1-6480-4b22-8126-334d62b54387 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450253 Jan 05 15:06:04.337944 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac req-108aafe7-767a-4767-8f23-ae85514a75aa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:04.339631 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac req-108aafe7-767a-4767-8f23-ae85514a75aa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 943 time: 0.0527587 Jan 05 15:06:04.393031 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-99a5bf78-9e2f-4e36-83eb-2fc72fc981ac req-76b724d4-cf23-4279-b927-7b2985821308 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466347 Jan 05 15:06:04.412459 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:04.423943 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'port_id': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', 'mac_address': 'fa:16:3e:df:b4:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9561926f-aba3-4028-bd06-409215177cc6', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:06:04.450822 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:04.463073 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:04.475894 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:06:04.499601 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:04.780451 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:04.827358 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:05.064395 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:06:05.448386 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6ded08b-386f-496e-bdc8-3859ae855e65 req-0722bd94-7196-4c8f-af8f-349ea037977c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:05.449909 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e6ded08b-386f-496e-bdc8-3859ae855e65 req-0722bd94-7196-4c8f-af8f-349ea037977c tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0496914 Jan 05 15:06:05.501706 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e6ded08b-386f-496e-bdc8-3859ae855e65 req-ac3b6e4e-e403-4f05-b5e9-d03968756c9f tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439982 Jan 05 15:06:05.527122 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 req-e9c23ed0-6184-48b7-9b56-29ff857b1037 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:05.529098 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 req-e9c23ed0-6184-48b7-9b56-29ff857b1037 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 944 time: 0.0652227 Jan 05 15:06:05.577782 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f6a0ca7d-692c-46f4-b5b2-23c9946ee369 req-8fa387a2-6079-4c69-b60d-b9ffd8e1d3ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414374 Jan 05 15:06:06.316269 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:06:06.448656 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:06:06.452367 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:06:06.455470 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:06.531619 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:06.557050 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:06.559271 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-05ebaf86-a5e4-472d-9b83-fbb663719520" -d '{"events": [{"server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "name": "network-vif-plugged", "status": "completed", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:06.575363 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:06.594457 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc x-openstack-request-id: req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:06.594771 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "name": "network-vif-plugged", "status": "completed", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:06.595029 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ead70de7-0d7f-4ee8-be3b-9ad93003c6cc {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:06.595425 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', 'code': 200} Jan 05 15:06:06.638843 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b req-6efb2cbe-a615-4030-aa90-153d9a602313 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:06.640557 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b req-6efb2cbe-a615-4030-aa90-153d9a602313 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0561497 Jan 05 15:06:06.652779 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:06.704748 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a8d2d7bc-3cd5-41ae-a7b1-d45856cbe82b req-54be6899-a67a-4920-a167-4cccf13a63b2 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0547085 Jan 05 15:06:06.709766 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:06.713245 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 req-8b0f3b67-8f5b-45f3-8d63-823ed18b9c48 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:06.714950 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 req-8b0f3b67-8f5b-45f3-8d63-823ed18b9c48 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 945 time: 0.0636938 Jan 05 15:06:06.764219 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c58922b5-e4a6-47f7-9d0a-77a7b2a50968 req-e5f6b622-7762-46f7-9661-93727210b6ab tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435133 Jan 05 15:06:06.940170 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81f291b-79ac-40c3-ad29-7daf52087997 req-4b24c380-3f38-4ee0-9851-7121781ae2a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:06.941726 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c81f291b-79ac-40c3-ad29-7daf52087997 req-4b24c380-3f38-4ee0-9851-7121781ae2a3 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 1098 time: 0.0393350 Jan 05 15:06:06.983766 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c81f291b-79ac-40c3-ad29-7daf52087997 req-9f8ad7c6-87cf-4aa2-b93d-a3c342100dc5 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362678 Jan 05 15:06:07.882442 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b65224-af99-4cb5-91f4-7815e1627d4b req-248a57ba-f007-4229-8c25-7f78dbc897ec tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:07.883919 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c4b65224-af99-4cb5-91f4-7815e1627d4b req-248a57ba-f007-4229-8c25-7f78dbc897ec tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 945 time: 0.0549228 Jan 05 15:06:07.929645 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c4b65224-af99-4cb5-91f4-7815e1627d4b req-d9b04b73-6657-4f2c-ad17-4798e1bb7551 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402048 Jan 05 15:06:08.047446 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7774f38-2ee8-480c-bda2-2bbeebfab91b req-97c729b9-c320-47c8-8bee-44c0d6ebf878 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:08.048928 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d7774f38-2ee8-480c-bda2-2bbeebfab91b req-97c729b9-c320-47c8-8bee-44c0d6ebf878 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0479341 Jan 05 15:06:08.101439 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d7774f38-2ee8-480c-bda2-2bbeebfab91b req-ec5d42bb-c7a0-400e-b67d-22dfec4567de tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463393 Jan 05 15:06:09.046497 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb req-5bdf1ba2-a5c7-4b13-a64d-a3f1219f05a5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:09.047926 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb req-5bdf1ba2-a5c7-4b13-a64d-a3f1219f05a5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 945 time: 0.0508249 Jan 05 15:06:09.094058 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6e830d7d-f97f-426e-b6e5-c2831d7a15cb req-b52f60f4-5b2c-4ec6-8ca2-fefa708d32f2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406866 Jan 05 15:06:09.215813 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f307822-b48e-4fa9-836c-1c84e6584990 req-5e2bd0aa-812f-4e36-ae81-ffb17d93e6b6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:09.217229 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8f307822-b48e-4fa9-836c-1c84e6584990 req-5e2bd0aa-812f-4e36-ae81-ffb17d93e6b6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0481875 Jan 05 15:06:09.265901 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8f307822-b48e-4fa9-836c-1c84e6584990 req-b0b0cf42-4eeb-4b96-8c95-f44588e72af5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431080 Jan 05 15:06:10.379584 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb req-f15a974d-ca82-4e73-b902-76b67673e5f3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:10.381081 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb req-f15a974d-ca82-4e73-b902-76b67673e5f3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0483534 Jan 05 15:06:10.435136 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4cf628fc-9d82-4cbf-9a95-876cd2620bfb req-09382ce0-722d-4a32-8e13-d3da79ff3b2f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428629 Jan 05 15:06:11.544914 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab0a98e-df15-4c65-b393-eadbc439e192 req-0d4bc9a5-3c85-492e-9fda-12038b82e721 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:11.546370 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cab0a98e-df15-4c65-b393-eadbc439e192 req-0d4bc9a5-3c85-492e-9fda-12038b82e721 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0499904 Jan 05 15:06:11.595017 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-cab0a98e-df15-4c65-b393-eadbc439e192 req-040367ee-7b8b-4801-878d-35012dff64e3 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431447 Jan 05 15:06:12.714352 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5884b1f6-95f5-4152-a82a-2200a546da44 req-069af13a-dd31-48b5-8ca3-2d5ea89e6c2e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:12.715711 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5884b1f6-95f5-4152-a82a-2200a546da44 req-069af13a-dd31-48b5-8ca3-2d5ea89e6c2e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0513690 Jan 05 15:06:12.764067 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5884b1f6-95f5-4152-a82a-2200a546da44 req-611f7fe5-e851-4a07-8eb7-3214a74bb099 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428483 Jan 05 15:06:13.874582 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820810f6-e977-4a5b-8e0b-7e5d39bd011f req-4e865b26-d6c1-4919-92e1-3f30ccdd64c8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:13.876066 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-820810f6-e977-4a5b-8e0b-7e5d39bd011f req-4e865b26-d6c1-4919-92e1-3f30ccdd64c8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0479043 Jan 05 15:06:13.923216 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-820810f6-e977-4a5b-8e0b-7e5d39bd011f req-0114bb81-180c-4784-871f-817923dfc5d9 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416818 Jan 05 15:06:13.966235 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:06:15.036790 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6abafdb7-2e17-4360-a54d-988da781e38b req-91c40e76-7c73-4eb7-8703-2e8279773ca6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:15.038262 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6abafdb7-2e17-4360-a54d-988da781e38b req-91c40e76-7c73-4eb7-8703-2e8279773ca6 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0476387 Jan 05 15:06:15.090768 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6abafdb7-2e17-4360-a54d-988da781e38b req-ff894697-3ec9-4f76-a026-0139680a6c6e tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470343 Jan 05 15:06:16.205921 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b60c314-dcca-4baa-be5c-1669bbb52489 req-93dc7c5b-86bf-49bd-b5dd-17d339b64b22 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:16.207368 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8b60c314-dcca-4baa-be5c-1669bbb52489 req-93dc7c5b-86bf-49bd-b5dd-17d339b64b22 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0506270 Jan 05 15:06:16.254109 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8b60c314-dcca-4baa-be5c-1669bbb52489 req-77f9f92f-a28d-4dc1-b10f-9193e8a102db tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413141 Jan 05 15:06:17.365020 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a971bafd-9db4-4592-a3f2-cd649b4504bc req-5de4bbd7-9e7f-4573-8c80-adfa480c2177 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:17.366488 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a971bafd-9db4-4592-a3f2-cd649b4504bc req-5de4bbd7-9e7f-4573-8c80-adfa480c2177 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0477896 Jan 05 15:06:17.414038 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a971bafd-9db4-4592-a3f2-cd649b4504bc req-f777d3f2-1093-4121-92c5-3bf79725cced tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415907 Jan 05 15:06:18.374853 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-7f738db4-3e62-4b83-982f-f06383f4fc15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:18.376300 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-7f738db4-3e62-4b83-982f-f06383f4fc15 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1098 time: 0.0391955 Jan 05 15:06:18.469130 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-e7573472-d8da-492a-81b6-92273f17602d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:18.470648 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-e7573472-d8da-492a-81b6-92273f17602d service neutron] 10.222.0.13 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 909 time: 0.0866284 Jan 05 15:06:18.530156 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce req-c0aed0d3-23c5-408f-916b-3b09b7cf7620 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:18.531620 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce req-c0aed0d3-23c5-408f-916b-3b09b7cf7620 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0487928 Jan 05 15:06:18.535215 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-a6f8cdf4-ee35-46df-a152-822d701d89ea service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 1001 time: 0.0586009 Jan 05 15:06:18.579159 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6fce71b1-f5d3-48c0-bfa9-7e72a84fa2ce req-ef70b357-a6b0-4ff9-88a3-c8138968c702 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419185 Jan 05 15:06:18.581803 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-399c3f00-c526-46fb-881e-d414ecd46dae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:18.583251 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-399c3f00-c526-46fb-881e-d414ecd46dae service neutron] 10.222.0.13 "GET /v2.0/subnets?id=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 200 len: 847 time: 0.0423658 Jan 05 15:06:18.630901 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-2e2fc530-9f70-4623-8d6b-4743da2307ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:18.632273 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-2e2fc530-9f70-4623-8d6b-4743da2307ac service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=e5205e82-a517-4157-848a-78560d0d2806&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0423620 Jan 05 15:06:18.718360 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-af726038-2b42-45b2-a4b6-bafec0a3eb04 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802746 Jan 05 15:06:18.813394 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d832d6f1-308d-4584-8b8e-19958af83c13 req-4cf2d4b3-0fec-4378-a915-38a941c71431 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895607 Jan 05 15:06:19.695713 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9647fb4f-85dd-406b-bbac-149945079ebd req-f859f238-7daa-43ac-8c18-fb075117abb8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:19.697258 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9647fb4f-85dd-406b-bbac-149945079ebd req-f859f238-7daa-43ac-8c18-fb075117abb8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0519466 Jan 05 15:06:19.745986 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9647fb4f-85dd-406b-bbac-149945079ebd req-2d0bc719-c223-49b6-b407-7a6f56cf444a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425460 Jan 05 15:06:20.598100 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-9c5615b3-8379-45bf-9409-7af42ff60f0d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:20.599541 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-9c5615b3-8379-45bf-9409-7af42ff60f0d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.1047513 Jan 05 15:06:20.613930 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-d47254d1-860c-4cba-89bc-e6e0999f698d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/quotas/97821d0c0c79446abba323f103c8244a HTTP/1.1" status: 200 len: 375 time: 0.0087514 Jan 05 15:06:20.660767 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-20addd6c-bc94-44c2-9f8c-b1d74fd3e63c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0421093 Jan 05 15:06:20.750537 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-568bac19-ac50-4e6e-8411-eac829e28ade service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832398 Jan 05 15:06:20.870075 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 req-6960413f-3ff2-4602-ab39-888c077c68e8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:20.872167 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 req-6960413f-3ff2-4602-ab39-888c077c68e8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0508986 Jan 05 15:06:20.926646 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-edf3ab05-4a8f-405e-9be2-0b54315ff9a2 req-2e58825c-c476-4416-9a0e-3e2423e95f80 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486894 Jan 05 15:06:21.084828 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-d316c683-70ba-4503-9f68-df2706d7ccfb service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3286541 Jan 05 15:06:21.304927 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f6ab5e47-3023-4290-8e36-1b3fc4d3ea9a req-1f267767-6500-4ce4-91d0-fe40f4f81322 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 210 time: 0.0260022 Jan 05 15:06:22.043895 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e646c7ae-4467-4d92-a546-5d33f2e94cfc req-064df06b-4174-499d-96fa-522107701dfd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:22.045369 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e646c7ae-4467-4d92-a546-5d33f2e94cfc req-064df06b-4174-499d-96fa-522107701dfd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0480297 Jan 05 15:06:22.096217 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e646c7ae-4467-4d92-a546-5d33f2e94cfc req-9566fc8d-6ece-4d8e-a613-17b9382a4d6f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453079 Jan 05 15:06:22.393929 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-20500766-9821-4442-8d7d-4afb8db760b1 req-bf8155ee-b567-40ce-8d6c-b7a692c483a7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 210 time: 0.0257781 Jan 05 15:06:22.553237 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 req-5bfc9613-c649-4d70-ae18-8fa8949643fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:22.554682 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 req-5bfc9613-c649-4d70-ae18-8fa8949643fa tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0486698 Jan 05 15:06:22.596331 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50080) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:22.607254 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1c96640a-46f5-4c57-ae5d-3f50a2c1ab64 req-3b51c943-6c66-4bf4-a297-1db362e6d718 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462956 Jan 05 15:06:22.681957 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-bd956135-81fb-489f-98ba-8def18f33d0e service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0838799 Jan 05 15:06:22.690927 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-cb60456e-1ecd-4c73-85db-523ddd4c3076 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 15:06:22.691873 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-cb60456e-1ecd-4c73-85db-523ddd4c3076 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048354 Jan 05 15:06:23.488325 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1fea6c6d-4d14-4d39-a122-2e7c216686a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:23.489816 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1fea6c6d-4d14-4d39-a122-2e7c216686a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.1167676 Jan 05 15:06:23.504978 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-76b24617-bf81-4d73-a345-b8298f4cc94b req-ca762991-3743-47dc-90e9-a2f55eee1db0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 210 time: 0.0416310 Jan 05 15:06:23.515586 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Request body: {'port': {'device_id': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'admin_state_up': True, 'tenant_id': '97821d0c0c79446abba323f103c8244a'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:06:23.694176 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Made reservation on behalf of 97821d0c0c79446abba323f103c8244a for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:06:23.697846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:23.725353 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12c50a06-5924-42f9-9744-5c2f5effd51b req-ba4a0c66-78c5-463c-a4c4-95dd4bbfd44b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:23.733385 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-12c50a06-5924-42f9-9744-5c2f5effd51b req-ba4a0c66-78c5-463c-a4c4-95dd4bbfd44b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0496662 Jan 05 15:06:23.795258 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-12c50a06-5924-42f9-9744-5c2f5effd51b req-ef4cd6c8-6ff2-43d3-a9bd-b07c12ad1211 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614276 Jan 05 15:06:23.834994 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Allocated IP 172.20.0.9 (15d9f439-989e-49bd-a540-259f7f374d29/9561926f-aba3-4028-bd06-409215177cc6/13cea986-c954-4f2a-80f4-f2a459e8a695) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:06:23.977684 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.100382 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.145220 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:06:24.149705 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Network 15d9f439-989e-49bd-a540-259f7f374d29 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:06:24.153576 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:06:24.157752 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:06:24.166291 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event updated for resources: {'Port': ['ID=13cea986-c954-4f2a-80f4-f2a459e8a695,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:24.211158 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:24.211769 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.294966 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-1c0016bc-98c4-456c-addb-cde1426b3fca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7848740 Jan 05 15:06:24.310646 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Request body: {'port': {'device_id': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:06:24.365178 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.410834 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b7c14da5-847f-4d0d-9e0e-5c9ad34c581c no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:06:24.619489 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.643041 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:24.645314 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6ee5577-46b8-422e-8d74-44cfc938cc2b" -d '{"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-unplugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:24.658225 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:24.679733 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e x-openstack-request-id: req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:24.679733 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-unplugged", "status": "failed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c", "code": 422}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:24.679733 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1fd6d3a2-ad5a-41d2-9fa4-465c0324667e {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:24.679733 dv-cinder-master-3-iscsi neutron-server[114656]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'code': 422} returned with failed status Jan 05 15:06:24.681136 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da978480-5a07-49fa-85df-000f0c2ddac4 req-b95dd735-4ed0-4f89-b147-76b85c1f4afd tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:24.688352 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da978480-5a07-49fa-85df-000f0c2ddac4 req-b95dd735-4ed0-4f89-b147-76b85c1f4afd tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 931 time: 0.1034412 Jan 05 15:06:24.709750 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13cea986-c954-4f2a-80f4-f2a459e8a695 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:06:24.718515 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.732153 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.751333 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Transition to ACTIVE for port object 13cea986-c954-4f2a-80f4-f2a459e8a695 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:06:24.756560 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-da978480-5a07-49fa-85df-000f0c2ddac4 req-1c2fffc1-3cbf-4b82-964f-5a778777d160 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673804 Jan 05 15:06:24.784528 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=6']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:24.791433 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.791813 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.792754 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.793159 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.793506 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.793836 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.794171 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.794508 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.794830 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.795156 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.795485 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.795806 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.796124 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:24.801229 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.853971 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Pushing event updated for resources: {'Port': ['ID=13cea986-c954-4f2a-80f4-f2a459e8a695,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:24.918518 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b68d64-6356-427d-9a6d-3e09030a543c req-81e4d11d-ee7f-491a-810d-c19f140d456a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:24.919181 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Attempting to bind port 13cea986-c954-4f2a-80f4-f2a459e8a695 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:06:24.919521 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Attempting to bind port 13cea986-c954-4f2a-80f4-f2a459e8a695 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:06:24.924747 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Attempting to bind port 13cea986-c954-4f2a-80f4-f2a459e8a695 on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:06:24.924873 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-04b68d64-6356-427d-9a6d-3e09030a543c req-81e4d11d-ee7f-491a-810d-c19f140d456a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0500789 Jan 05 15:06:24.924986 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Port 13cea986-c954-4f2a-80f4-f2a459e8a695 on network 15d9f439-989e-49bd-a540-259f7f374d29 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:06:24.924986 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Attempting to bind port 13cea986-c954-4f2a-80f4-f2a459e8a695 on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:06:24.929287 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 6, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:06:24.929626 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Checking segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:06:24.930001 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Bound using segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:06:24.930425 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Bound port: 13cea986-c954-4f2a-80f4-f2a459e8a695, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:06:24.930784 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:24.970179 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-04b68d64-6356-427d-9a6d-3e09030a543c req-5a5c7219-2735-43ca-8ba3-22b55930a94c tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433712 Jan 05 15:06:24.995364 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] For port 13cea986-c954-4f2a-80f4-f2a459e8a695, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:06:24.998397 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] For port 13cea986-c954-4f2a-80f4-f2a459e8a695, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=13cea986-c954-4f2a-80f4-f2a459e8a695,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:06:25.087082 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:25.122042 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.122665 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:25.124036 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] 10.222.0.13 "PUT /v2.0/ports/13cea986-c954-4f2a-80f4-f2a459e8a695 HTTP/1.1" status: 200 len: 1093 time: 0.8175902 Jan 05 15:06:25.124471 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'tag': '13cea986-c954-4f2a-80f4-f2a459e8a695'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:25.126728 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d310c84e-2dcd-4e9f-9dca-481d803630c0" -d '{"events": [{"name": "network-changed", "server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:25.149554 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afdfd35e-b8d0-46dd-add1-4275f02d789f service neutron] Pushing event updated for resources: {'Port': ['ID=13cea986-c954-4f2a-80f4-f2a459e8a695,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:25.171185 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-920a5b8c-4557-4036-b732-cc26ff4f8b13 x-openstack-request-id: req-920a5b8c-4557-4036-b732-cc26ff4f8b13 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:25.171185 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:25.171185 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-920a5b8c-4557-4036-b732-cc26ff4f8b13 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:25.171185 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'tag': '13cea986-c954-4f2a-80f4-f2a459e8a695', 'status': 'completed', 'code': 200} Jan 05 15:06:25.253423 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-afb915bd-db04-40d2-8e65-d8408546ab56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.254951 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-afb915bd-db04-40d2-8e65-d8408546ab56 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 1096 time: 0.0395403 Jan 05 15:06:25.360550 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-45fffdad-fd76-4a17-85bd-8e410af95dfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.362030 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-45fffdad-fd76-4a17-85bd-8e410af95dfd service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=97821d0c0c79446abba323f103c8244a&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0915468 Jan 05 15:06:25.456018 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-732dd035-6334-41c1-8866-5d5697159adb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.457377 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d310c84e-2dcd-4e9f-9dca-481d803630c0 req-732dd035-6334-41c1-8866-5d5697159adb service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0857327 Jan 05 15:06:25.590797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-978609cc-b7a3-4788-9fa4-422f4faed2d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.592259 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-978609cc-b7a3-4788-9fa4-422f4faed2d8 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 1096 time: 0.0717852 Jan 05 15:06:25.597221 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-4cd6fb11-519e-44b8-9efd-53d872639184 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.598534 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-4cd6fb11-519e-44b8-9efd-53d872639184 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af&tenant_id=c3797435200949c8a45be6c5b0525dc0 HTTP/1.1" status: 200 len: 1096 time: 0.0535045 Jan 05 15:06:25.671198 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-307047ba-5b70-4946-a3f6-6407c2bf7888 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=13cea986-c954-4f2a-80f4-f2a459e8a695 HTTP/1.1" status: 200 len: 217 time: 0.0413387 Jan 05 15:06:25.736504 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-25e172d2-f42d-44c8-bd4d-130c775aa92e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.737875 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-25e172d2-f42d-44c8-bd4d-130c775aa92e service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1096 time: 0.0750387 Jan 05 15:06:25.742800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-3ed0abd7-e5ae-4e9e-b7b4-4b16fcf04c58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.744138 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-3ed0abd7-e5ae-4e9e-b7b4-4b16fcf04c58 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=9561926f-aba3-4028-bd06-409215177cc6 HTTP/1.1" status: 200 len: 854 time: 0.0564871 Jan 05 15:06:25.874904 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13577ad-d96a-431c-b0bb-b274b7e39f33 req-08922ce1-9142-4a11-bdd4-7b16aa43e776 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:25.876462 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b13577ad-d96a-431c-b0bb-b274b7e39f33 req-08922ce1-9142-4a11-bdd4-7b16aa43e776 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 943 time: 0.0500467 Jan 05 15:06:25.924147 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b13577ad-d96a-431c-b0bb-b274b7e39f33 req-3c54c33d-5cff-427a-bbb3-7e284cb4b34d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418656 Jan 05 15:06:26.039681 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-5e51a775-f9cf-400a-b829-57fc69e4f1b6 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=15d9f439-989e-49bd-a540-259f7f374d29&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2872143 Jan 05 15:06:26.222463 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61596098-02ec-4ed8-b579-63d16df32661 req-f3f0c1b3-2e6c-4218-a1b9-9bfd245a95f8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:26.224588 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-61596098-02ec-4ed8-b579-63d16df32661 req-f3f0c1b3-2e6c-4218-a1b9-9bfd245a95f8 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.1598427 Jan 05 15:06:26.228099 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-f2ac889a-5345-4fa5-abb2-a68464882737 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:26.230546 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-f2ac889a-5345-4fa5-abb2-a68464882737 service neutron] 10.222.0.13 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 909 time: 0.4855707 Jan 05 15:06:26.241981 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-fecc0c6a-966a-4de0-81e1-115095cfdd1f service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1784174 Jan 05 15:06:26.375758 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-5c90dc8d-553e-436c-a060-c2fd1b67573c service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 999 time: 0.1328979 Jan 05 15:06:26.381312 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-61596098-02ec-4ed8-b579-63d16df32661 req-8f518c9f-91fb-4edf-9655-04b925e0e4ab tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1480441 Jan 05 15:06:26.441332 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0f954d18-1e99-4702-bc75-18d81544f6c1 req-96d3082c-2cff-43e5-b6ba-211e0f004e0b service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1926272 Jan 05 15:06:26.444676 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-dab91b89-3ef7-474c-ac03-cb4fbf40e58f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:26.446013 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-dab91b89-3ef7-474c-ac03-cb4fbf40e58f service neutron] 10.222.0.13 "GET /v2.0/subnets?id=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 200 len: 847 time: 0.0625765 Jan 05 15:06:26.496471 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-ca30ee64-9b04-49d9-b181-bcce34682d53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:26.498715 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-ca30ee64-9b04-49d9-b181-bcce34682d53 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=e5205e82-a517-4157-848a-78560d0d2806&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404916 Jan 05 15:06:26.593026 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-1a736d58-a626-436c-b5c1-9f5237888419 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870092 Jan 05 15:06:26.706673 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-b969853e-2929-4f1e-8fbc-dac294f42d22 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0801990 Jan 05 15:06:27.043394 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a68a548-b7fc-48aa-8549-76624a6b544b req-dea32182-8fe7-4a1c-901a-b42d8afa9006 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:27.044824 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8a68a548-b7fc-48aa-8549-76624a6b544b req-dea32182-8fe7-4a1c-901a-b42d8afa9006 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 943 time: 0.0513389 Jan 05 15:06:27.090323 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8a68a548-b7fc-48aa-8549-76624a6b544b req-95e5425d-faf8-4f2a-967a-817b6a866795 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400469 Jan 05 15:06:27.497805 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c req-ee8851b0-34e6-4b72-84c6-088dee22b303 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:27.499265 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c req-ee8851b0-34e6-4b72-84c6-088dee22b303 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0530200 Jan 05 15:06:27.547244 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-50ef2d78-cf03-4a4c-bb2f-d0a138b24f8c req-7a68524d-844c-45f0-ae3f-f2da7c67245d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425346 Jan 05 15:06:28.197270 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-aceec977-c911-4e0d-bd19-e66ea87db184 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:28.353549 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f31985-114f-4dde-979a-f928cc9821c9 req-bd4d7433-50ab-436b-b383-821f12000582 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:28.354959 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-96f31985-114f-4dde-979a-f928cc9821c9 req-bd4d7433-50ab-436b-b383-821f12000582 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 943 time: 0.0483837 Jan 05 15:06:28.400103 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-96f31985-114f-4dde-979a-f928cc9821c9 req-ccf23664-e0ab-4525-8d7a-ad8f2772a790 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397732 Jan 05 15:06:28.661092 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaedb466-3bf2-4749-82f1-6c6c24018032 req-41649a94-50bb-414c-bfd2-c05240027ce5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:28.662604 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-aaedb466-3bf2-4749-82f1-6c6c24018032 req-41649a94-50bb-414c-bfd2-c05240027ce5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0505114 Jan 05 15:06:28.710968 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-aaedb466-3bf2-4749-82f1-6c6c24018032 req-02b45e0b-bbcc-4faf-a7f5-65f6d9b1bb6f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422971 Jan 05 15:06:29.509789 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1be915f-ea79-43fd-947e-0643598fa05a req-44d82985-0daa-4230-a933-12b82653bca9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:29.512192 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e1be915f-ea79-43fd-947e-0643598fa05a req-44d82985-0daa-4230-a933-12b82653bca9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 943 time: 0.0479262 Jan 05 15:06:29.559924 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e1be915f-ea79-43fd-947e-0643598fa05a req-64e7367c-2510-43d5-bc5f-d4922c29e1b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427070 Jan 05 15:06:29.825801 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69629466-0ab5-40b3-806a-8eb2c27028ee req-9f3d942a-9a2d-4cd1-b72b-8bb50ab06659 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:29.827285 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-69629466-0ab5-40b3-806a-8eb2c27028ee req-9f3d942a-9a2d-4cd1-b72b-8bb50ab06659 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0483193 Jan 05 15:06:29.880152 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-69629466-0ab5-40b3-806a-8eb2c27028ee req-d3a10f34-67b9-4b4f-8dfd-7a41d52409ab tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474730 Jan 05 15:06:30.371862 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a414a2f9-3718-4efd-99f8-fdcb44cafebf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:30.444340 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 13cea986-c954-4f2a-80f4-f2a459e8a695 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:06:30.550892 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 13cea986-c954-4f2a-80f4-f2a459e8a695, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=13cea986-c954-4f2a-80f4-f2a459e8a695,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:30.568458 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '13cea986-c954-4f2a-80f4-f2a459e8a695', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'port_id': '13cea986-c954-4f2a-80f4-f2a459e8a695', 'mac_address': 'fa:16:3e:3a:a1:a9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9561926f-aba3-4028-bd06-409215177cc6', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:06:30.610380 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:30.627223 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 13cea986-c954-4f2a-80f4-f2a459e8a695 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:06:30.649720 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 13cea986-c954-4f2a-80f4-f2a459e8a695, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=13cea986-c954-4f2a-80f4-f2a459e8a695,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:30.674183 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b31b081-5883-46f9-9cb8-f4266bd904b8 req-8919c92c-d676-4f31-8ec9-99ee6ad8c792 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:30.675683 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1b31b081-5883-46f9-9cb8-f4266bd904b8 req-8919c92c-d676-4f31-8ec9-99ee6ad8c792 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 943 time: 0.0500455 Jan 05 15:06:30.711596 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:30.722873 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1b31b081-5883-46f9-9cb8-f4266bd904b8 req-5688e345-d1e6-40f8-b0fb-762d3287fc20 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414701 Jan 05 15:06:30.758962 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=13cea986-c954-4f2a-80f4-f2a459e8a695,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:30.994743 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef5e32b-656c-470e-8a0c-4f189b137351 req-9f7b3be1-7845-41d1-b869-28a7c78407da tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:30.996257 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8ef5e32b-656c-470e-8a0c-4f189b137351 req-9f7b3be1-7845-41d1-b869-28a7c78407da tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0497367 Jan 05 15:06:31.044745 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['13cea986-c954-4f2a-80f4-f2a459e8a695'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:06:31.046933 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8ef5e32b-656c-470e-8a0c-4f189b137351 req-3497a83d-adfe-4793-8952-91f7e9bc08b9 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452340 Jan 05 15:06:31.834838 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:31.835468 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e req-01474ac9-2990-4cf0-ba49-73ffd0505d5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:31.836943 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e req-01474ac9-2990-4cf0-ba49-73ffd0505d5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 944 time: 0.0474060 Jan 05 15:06:31.883126 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8eeef00e-b6d1-4baf-8aa5-9ab72af2328e req-a595563a-2afb-4f85-869e-d04a1a5976b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406942 Jan 05 15:06:32.159618 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5935b77-75df-4dd9-9df9-201d0f04379e req-816306b8-7d41-4f90-8dda-3a3fe1fda718 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:32.161090 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b5935b77-75df-4dd9-9df9-201d0f04379e req-816306b8-7d41-4f90-8dda-3a3fe1fda718 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0477958 Jan 05 15:06:32.208432 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b5935b77-75df-4dd9-9df9-201d0f04379e req-9a9cabbf-d3e8-4075-bdf5-24d31107cda2 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418818 Jan 05 15:06:32.445534 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 13cea986-c954-4f2a-80f4-f2a459e8a695 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:06:32.550837 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 13cea986-c954-4f2a-80f4-f2a459e8a695 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:06:32.554784 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 13cea986-c954-4f2a-80f4-f2a459e8a695 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:06:32.555159 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:32.632145 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:32.654600 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13cea986-c954-4f2a-80f4-f2a459e8a695'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:32.656804 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a390db1-c161-4eed-9624-8fac206475c3" -d '{"events": [{"server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "name": "network-vif-plugged", "status": "completed", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:32.672899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 13cea986-c954-4f2a-80f4-f2a459e8a695, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=13cea986-c954-4f2a-80f4-f2a459e8a695,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:32.693295 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-201cf43e-046d-461e-a79f-35d79143e423 x-openstack-request-id: req-201cf43e-046d-461e-a79f-35d79143e423 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:32.693622 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "name": "network-vif-plugged", "status": "completed", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:32.693876 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-201cf43e-046d-461e-a79f-35d79143e423 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:32.694264 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13cea986-c954-4f2a-80f4-f2a459e8a695', 'code': 200} Jan 05 15:06:32.762683 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:32.786362 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:32.811574 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=13cea986-c954-4f2a-80f4-f2a459e8a695,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:32.999270 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4539a11-51fb-49a7-bf56-d95d884da781 req-998232f8-8ed2-46bf-abe2-72d9ebbf4912 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:33.000792 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d4539a11-51fb-49a7-bf56-d95d884da781 req-998232f8-8ed2-46bf-abe2-72d9ebbf4912 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 945 time: 0.0539196 Jan 05 15:06:33.047715 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d4539a11-51fb-49a7-bf56-d95d884da781 req-5b0c21d1-068d-44e6-8701-573a84a38ec2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413384 Jan 05 15:06:33.092204 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd7f7e9e-cf39-4cb7-82b2-42a21deb1e6a req-3cc333c2-3397-471e-9563-5301f83e818c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:33.093732 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fd7f7e9e-cf39-4cb7-82b2-42a21deb1e6a req-3cc333c2-3397-471e-9563-5301f83e818c service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 1098 time: 0.0400162 Jan 05 15:06:33.143141 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fd7f7e9e-cf39-4cb7-82b2-42a21deb1e6a req-1f60c56a-6b03-46a0-a005-a247b3bda788 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396771 Jan 05 15:06:33.325767 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 req-d441d817-ddd5-471c-8104-d00075cb0eb0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:33.327116 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 req-d441d817-ddd5-471c-8104-d00075cb0eb0 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0510983 Jan 05 15:06:33.374038 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-02095eef-0a6e-41b6-9ba8-3dd348fa0cc0 req-64f86acc-2e98-4935-a778-79ec7515b363 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415010 Jan 05 15:06:33.539798 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:34.160887 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df1184e-c2c0-426d-af30-dfef022afa26 req-7112d72a-4558-4f15-ac32-68b11fad3283 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:34.162473 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1df1184e-c2c0-426d-af30-dfef022afa26 req-7112d72a-4558-4f15-ac32-68b11fad3283 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 945 time: 0.0493777 Jan 05 15:06:34.212849 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1df1184e-c2c0-426d-af30-dfef022afa26 req-2bd26db3-1331-4481-8f7a-1a0b1cd644ab tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444953 Jan 05 15:06:34.440511 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:34.487847 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb req-4ddd7e7c-4890-4e11-9392-197fdf455930 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:34.489956 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb req-4ddd7e7c-4890-4e11-9392-197fdf455930 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0486605 Jan 05 15:06:34.540686 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-305495f0-e1a0-4884-bdf3-2ed7bb1d95bb req-a670cbd7-d859-455f-a24c-b077f47c6bbd tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443678 Jan 05 15:06:35.267030 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-3bc5404a-5746-4b18-846e-1a8e68d46a5f service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0383575 Jan 05 15:06:35.352107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 req-950bde89-94f0-4aad-a25a-03b90be44219 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:35.353853 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 req-950bde89-94f0-4aad-a25a-03b90be44219 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 945 time: 0.0753305 Jan 05 15:06:35.360382 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c963344-5f94-475e-93ec-2a4321354d15 req-caef7a02-c43f-4ef1-9941-11d127cd0ad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:35.361758 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-caef7a02-c43f-4ef1-9941-11d127cd0ad6 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f4a45a70c5d046238abaad07fbe529e9&device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 1099 time: 0.0570996 Jan 05 15:06:35.453768 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5b2fb331-427b-4b09-ad83-ae955f6a92b3 req-b7e12829-7c27-46e0-8ffb-f427b536735a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0910740 Jan 05 15:06:35.484252 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c963344-5f94-475e-93ec-2a4321354d15 req-eb442def-5da2-40f9-b5d7-42805a7700c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:35.485726 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-eb442def-5da2-40f9-b5d7-42805a7700c9 service neutron] 10.222.0.13 "GET /v2.0/networks?id=1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 200 len: 918 time: 0.1029091 Jan 05 15:06:35.556698 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-fbd83a3f-4a3c-4b8f-b67f-52ddc9605958 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843 HTTP/1.1" status: 200 len: 1001 time: 0.0641279 Jan 05 15:06:35.606363 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c963344-5f94-475e-93ec-2a4321354d15 req-610046ee-2fd8-4bd2-b6a0-9c05986287b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:35.607838 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-610046ee-2fd8-4bd2-b6a0-9c05986287b9 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 200 len: 856 time: 0.0452561 Jan 05 15:06:35.681943 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6245799b-aa36-4345-a1a9-11720173c863 req-93bfcf36-17d8-4911-bf2b-f9158cba1d67 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:35.683593 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6245799b-aa36-4345-a1a9-11720173c863 req-93bfcf36-17d8-4911-bf2b-f9158cba1d67 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 943 time: 0.0747609 Jan 05 15:06:35.685343 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c963344-5f94-475e-93ec-2a4321354d15 req-0529a272-4122-471c-b86b-48b5d1289757 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:35.686647 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-0529a272-4122-471c-b86b-48b5d1289757 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=1c375b41-1339-4d14-93e7-e473aa7e6978&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0685830 Jan 05 15:06:35.784508 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6245799b-aa36-4345-a1a9-11720173c863 req-539585dc-6e0c-4fe9-8b17-2477fce111bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0953214 Jan 05 15:06:35.812453 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-5ca4aa13-8a10-4f85-b139-5793e6564e23 service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1165915 Jan 05 15:06:35.906410 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3c963344-5f94-475e-93ec-2a4321354d15 req-875e48e4-4b06-42b0-a15c-8cba58c8320a service neutron] 10.222.0.13 "GET /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859270 Jan 05 15:06:36.469710 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b7c14da5-847f-4d0d-9e0e-5c9ad34c581c details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:06:36.562695 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:36.573844 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'port_id': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'mac_address': 'fa:16:3e:0c:2c:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 129, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:06:36.610131 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:36.626680 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b7c14da5-847f-4d0d-9e0e-5c9ad34c581c {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:06:36.647943 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:36.711114 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:36.759031 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=7']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:36.900043 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b req-65f1fbdd-409a-403f-9e05-c68f6256f51d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:36.901996 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b req-65f1fbdd-409a-403f-9e05-c68f6256f51d tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 944 time: 0.0513361 Jan 05 15:06:36.949087 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c2a41ae6-0adf-44d0-8300-f97c0d3a2b7b req-f3b05cb4-2b81-472f-b555-2fcc98eb6b9b tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415924 Jan 05 15:06:37.080196 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:06:38.061392 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7537ed17-2acd-4280-8244-54862bbab9ad req-0d2c7126-b089-40ca-9b4f-513ed401a387 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:38.062853 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7537ed17-2acd-4280-8244-54862bbab9ad req-0d2c7126-b089-40ca-9b4f-513ed401a387 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 944 time: 0.0478208 Jan 05 15:06:38.112384 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7537ed17-2acd-4280-8244-54862bbab9ad req-d9492a83-39f5-46a4-914a-65ee1a9ae4f5 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440803 Jan 05 15:06:38.379148 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e92945-4726-4674-99b4-086d530d99e8 req-0494b619-2e93-4855-81ae-74fbd092a9db tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:38.380567 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-0494b619-2e93-4855-81ae-74fbd092a9db tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.1004260 Jan 05 15:06:38.394310 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-b6659f1d-207b-40d7-a2df-d694951e1a89 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/quotas/97821d0c0c79446abba323f103c8244a HTTP/1.1" status: 200 len: 375 time: 0.0084910 Jan 05 15:06:38.441819 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-13ae1294-2950-4f0d-88f9-50d05e87252f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0430164 Jan 05 15:06:38.475080 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b7c14da5-847f-4d0d-9e0e-5c9ad34c581c up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:06:38.523118 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:06:38.523613 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:38.534884 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-c5b04a45-1d1c-435b-bd5e-3d6e2af51740 service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866990 Jan 05 15:06:38.601094 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:38.621403 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-617a49ce-5012-49f1-be0b-b0b302e8b4a3 service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0808129 Jan 05 15:06:38.623753 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:38.626000 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f906037-a45e-49b0-88a0-abab9b152d47" -d '{"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-plugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:38.638795 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:38.661505 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0dee985-784e-4f69-ae9d-685545c3447a x-openstack-request-id: req-f0dee985-784e-4f69-ae9d-685545c3447a {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:38.661802 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-plugged", "status": "completed", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:38.662065 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f0dee985-784e-4f69-ae9d-685545c3447a {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:38.662482 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'code': 200} Jan 05 15:06:38.755973 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:38.809824 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=8']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:38.920475 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b3bd553b-2853-47d5-a7af-f90d8bfddf1c req-d0f9429a-c97b-4694-b219-c2fb81e6e548 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 210 time: 0.0273530 Jan 05 15:06:39.049574 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64a4412b-6957-4e20-be00-a4011e194303 req-49439606-53db-46ca-a2e7-4a2ffb60d0ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:39.051033 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-64a4412b-6957-4e20-be00-a4011e194303 req-49439606-53db-46ca-a2e7-4a2ffb60d0ad service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1098 time: 0.0447373 Jan 05 15:06:39.098116 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-64a4412b-6957-4e20-be00-a4011e194303 req-c28c8dc9-1a2e-495e-a19e-3c1b69173e07 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396023 Jan 05 15:06:39.230981 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773802d0-7385-4585-886c-924b95163ca3 req-7cb2873a-3275-4f9f-b19b-ac5be1bfff37 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:39.232423 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-773802d0-7385-4585-886c-924b95163ca3 req-7cb2873a-3275-4f9f-b19b-ac5be1bfff37 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0526469 Jan 05 15:06:39.282815 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-773802d0-7385-4585-886c-924b95163ca3 req-7ee7b759-d2cc-4b96-ae28-6107db69982a tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447366 Jan 05 15:06:39.382760 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09c39352-9149-45fb-bab3-61ab3798ad95 req-e84cde74-9114-432b-8151-5c19b3786c9d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:39.384217 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-09c39352-9149-45fb-bab3-61ab3798ad95 req-e84cde74-9114-432b-8151-5c19b3786c9d tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0605340 Jan 05 15:06:39.430105 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-09c39352-9149-45fb-bab3-61ab3798ad95 req-49b07247-f7ae-4f38-9683-51f750b72b76 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403383 Jan 05 15:06:40.025301 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-42631bb0-aa35-4124-b9f7-f092f17a057a req-0d570bd1-5ace-4102-834b-c4f891ebc925 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 210 time: 0.0373633 Jan 05 15:06:40.414142 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 req-61093e0f-b5e4-49ea-962a-f2a6cfe812ec tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:40.415625 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 req-61093e0f-b5e4-49ea-962a-f2a6cfe812ec tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0531797 Jan 05 15:06:40.463410 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f0e64534-50e1-4346-ab3b-d02fbaab1a75 req-8d6b90d7-a981-438f-9f79-9db63a06c140 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420835 Jan 05 15:06:40.550358 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb req-125cf684-7d8a-41fd-bc67-399868b735ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:40.551809 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb req-125cf684-7d8a-41fd-bc67-399868b735ff tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0485966 Jan 05 15:06:40.598364 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-167e4b16-d794-4fc8-a4ff-b7a15cfb73bb req-8ce33c59-f089-4fe5-8488-6b3953363e2b tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408022 Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.120401 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e92945-4726-4674-99b4-086d530d99e8 req-ae5ad7b7-27cc-419e-ba85-61d228daee3b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:41.123962 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-ae5ad7b7-27cc-419e-ba85-61d228daee3b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.1039085 Jan 05 15:06:41.127240 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-901bb390-7bae-41dc-a926-794765ee9f58 req-ea8327b2-6261-46e1-8392-30633616df07 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 210 time: 0.0285892 Jan 05 15:06:41.150049 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Request body: {'port': {'device_id': '0513327c-8038-49b0-a926-007e79f1c41c', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'admin_state_up': True, 'tenant_id': '97821d0c0c79446abba323f103c8244a'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:06:41.345209 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Made reservation on behalf of 97821d0c0c79446abba323f103c8244a for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:06:41.348800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:41.476877 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Allocated IP 172.20.0.4 (15d9f439-989e-49bd-a540-259f7f374d29/9561926f-aba3-4028-bd06-409215177cc6/b4ef5996-5211-497a-bab8-d83c88eea0df) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:06:41.647513 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32247f51-e30f-4516-9f4b-d9dfaa57cadc req-30fadc6d-1128-4664-a59b-96f933c996b4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:41.648998 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32247f51-e30f-4516-9f4b-d9dfaa57cadc req-30fadc6d-1128-4664-a59b-96f933c996b4 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.1047509 Jan 05 15:06:41.692227 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:41.720139 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8bad4f6-385e-433f-8949-3d058292ba36 req-fd2c8790-8513-4dc9-9eba-e2c3397a4ae7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:41.721660 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a8bad4f6-385e-433f-8949-3d058292ba36 req-fd2c8790-8513-4dc9-9eba-e2c3397a4ae7 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0504653 Jan 05 15:06:41.749703 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-32247f51-e30f-4516-9f4b-d9dfaa57cadc req-3c1b8fa0-d58f-4e8e-a20b-beffdfae4b95 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0951154 Jan 05 15:06:41.773789 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-a8bad4f6-385e-433f-8949-3d058292ba36 req-3e6fc011-106c-44a4-a586-97a5b13be0d0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups?id=e6bd0ca2-838f-4153-9be5-bb78f57bc543&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464227 Jan 05 15:06:41.810412 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-9d2075d9-3060-412b-8645-d9617bb8dfcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:41.811942 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-9d2075d9-3060-412b-8645-d9617bb8dfcd tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 946 time: 0.0600224 Jan 05 15:06:41.875065 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:41.909930 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', '13cea986-c954-4f2a-80f4-f2a459e8a695'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:06:41.924563 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Network 15d9f439-989e-49bd-a540-259f7f374d29 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:06:41.933468 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:06:41.937558 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:06:41.940314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event updated for resources: {'Port': ['ID=b4ef5996-5211-497a-bab8-d83c88eea0df,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:41.975937 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.976287 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.976634 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.976971 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.977588 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.977920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.978250 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.978580 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.978909 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.979234 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.979557 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.979879 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:41.980201 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:42.004249 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Deleting port 0d57813b-5531-41c7-8d8d-8b2fc393b843 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:06:42.004573 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.017103 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:42.017103 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.110908 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] For port 0d57813b-5531-41c7-8d8d-8b2fc393b843, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0d57813b-5531-41c7-8d8d-8b2fc393b843,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:42.111270 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.160952 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-294d0d8d-2786-4e72-82af-ba01302c40b9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0148191 Jan 05 15:06:42.185151 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Request body: {'port': {'device_id': '0513327c-8038-49b0-a926-007e79f1c41c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:06:42.358515 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 req-213d3ac0-eba4-47dd-8835-b9a0bd5565af tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:42.359966 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 req-213d3ac0-eba4-47dd-8835-b9a0bd5565af tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 931 time: 0.1660874 Jan 05 15:06:42.362613 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.387544 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.387906 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.388239 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Floating IP 4359b184-17b1-47c9-80b1-fc623c80beca disassociated. External IP: 172.37.2.143, port: 0d57813b-5531-41c7-8d8d-8b2fc393b843. Jan 05 15:06:42.388647 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling delete_port for 0d57813b-5531-41c7-8d8d-8b2fc393b843 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:06:42.494804 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-1b5b9bb5-4c8a-46c1-b6be-4c7a64b09ef0 req-ef966ae4-0c0b-43fb-ac27-59e9ab8edac9 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1277637 Jan 05 15:06:42.754019 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b4ef5996-5211-497a-bab8-d83c88eea0df {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:06:42.758065 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.768351 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.794411 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event deleted for resources: {'Port': ['ID=0d57813b-5531-41c7-8d8d-8b2fc393b843,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:42.808918 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Transition to ACTIVE for port object b4ef5996-5211-497a-bab8-d83c88eea0df will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:06:42.878620 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5c0787b0-9272-4b23-b054-dc6da112455d req-34257140-2bf3-447d-86d0-807ccb126cd0 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 210 time: 0.0291574 Jan 05 15:06:42.890540 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:42.962515 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Router 9ec87e52-56d6-4808-9eb4-61d2fe146230 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:06:42.964489 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Pushing event updated for resources: {'Port': ['ID=b4ef5996-5211-497a-bab8-d83c88eea0df,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:43.327691 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Attempting to bind port b4ef5996-5211-497a-bab8-d83c88eea0df on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:06:43.328399 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Attempting to bind port b4ef5996-5211-497a-bab8-d83c88eea0df by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:06:43.328399 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Attempting to bind port b4ef5996-5211-497a-bab8-d83c88eea0df on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:06:43.361191 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Port b4ef5996-5211-497a-bab8-d83c88eea0df on network 15d9f439-989e-49bd-a540-259f7f374d29 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:06:43.361514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Attempting to bind port b4ef5996-5211-497a-bab8-d83c88eea0df on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:06:43.370531 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 6, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:06:43.370805 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Checking segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:06:43.371224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Bound using segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:06:43.371644 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Bound port: b4ef5996-5211-497a-bab8-d83c88eea0df, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:06:43.371994 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:43.395518 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:06:43.405569 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] Sync routers for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:06:43.417623 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:06:43.418239 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:06:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:43.455830 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] No DVR routers for this DVR port 0d57813b-5531-41c7-8d8d-8b2fc393b843 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:06:43.462957 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:43.466874 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-886b083f-5e96-4d3a-8ce4-7195679e1926 req-2403deaa-bb3b-423e-86b6-3bc21677ce66 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.13 "DELETE /v2.0/ports/0d57813b-5531-41c7-8d8d-8b2fc393b843 HTTP/1.1" status: 204 len: 173 time: 1.6501234 Jan 05 15:06:43.467307 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-deleted', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:43.469625 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92200b9a-a462-49fb-9610-df9c81db9d38" -d '{"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-deleted", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:43.491255 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] For port b4ef5996-5211-497a-bab8-d83c88eea0df, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:06:43.495118 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] For port b4ef5996-5211-497a-bab8-d83c88eea0df, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b4ef5996-5211-497a-bab8-d83c88eea0df,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:06:43.518323 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53e68f5c-df6c-4b03-b5d2-e75072073e43 x-openstack-request-id: req-53e68f5c-df6c-4b03-b5d2-e75072073e43 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:43.518323 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a591f495-ff59-4865-87ea-c48041ea097f", "name": "network-vif-deleted", "tag": "0d57813b-5531-41c7-8d8d-8b2fc393b843", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:43.518323 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-53e68f5c-df6c-4b03-b5d2-e75072073e43 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:43.518323 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a591f495-ff59-4865-87ea-c48041ea097f', 'name': 'network-vif-deleted', 'tag': '0d57813b-5531-41c7-8d8d-8b2fc393b843', 'status': 'completed', 'code': 200} Jan 05 15:06:43.530219 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:06:43.566275 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:43.598362 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:43.598997 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:43.601045 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] 10.222.0.13 "PUT /v2.0/ports/b4ef5996-5211-497a-bab8-d83c88eea0df HTTP/1.1" status: 200 len: 1093 time: 1.4200373 Jan 05 15:06:43.614492 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49053876-02e9-4347-bdae-737ead3a2b45 req-3f393a3e-dc67-4285-b0af-49082af3205b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:43.616685 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49053876-02e9-4347-bdae-737ead3a2b45 req-3f393a3e-dc67-4285-b0af-49082af3205b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 943 time: 0.0543396 Jan 05 15:06:43.649704 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f287a6-9ac8-460d-ad12-16e05cc58543 service neutron] Pushing event updated for resources: {'Port': ['ID=b4ef5996-5211-497a-bab8-d83c88eea0df,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:43.680397 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49053876-02e9-4347-bdae-737ead3a2b45 req-7542c211-11eb-43a5-9ada-7e91f2b0010c tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541611 Jan 05 15:06:43.747231 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:43.771718 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e92945-4726-4674-99b4-086d530d99e8 req-b1bcf866-b318-4f13-af22-46a0447e9430 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:43.773573 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-b1bcf866-b318-4f13-af22-46a0447e9430 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 1096 time: 0.0414817 Jan 05 15:06:43.777369 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] Checking router: 9ec87e52-56d6-4808-9eb4-61d2fe146230 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:06:43.787849 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:06:43.788451 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:06:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:43.831313 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-d30008dd-6f9a-4f2e-acb1-13748763168f service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b4ef5996-5211-497a-bab8-d83c88eea0df HTTP/1.1" status: 200 len: 217 time: 0.0382664 Jan 05 15:06:43.878235 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e92945-4726-4674-99b4-086d530d99e8 req-03b4d31b-49c4-44f3-98fc-556ebf32c006 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:43.879704 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-03b4d31b-49c4-44f3-98fc-556ebf32c006 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=9561926f-aba3-4028-bd06-409215177cc6 HTTP/1.1" status: 200 len: 854 time: 0.0431235 Jan 05 15:06:43.894413 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:06:43.910316 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-7a7362ef-a1e2-436a-b872-f17983460897 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=15d9f439-989e-49bd-a540-259f7f374d29&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250344 Jan 05 15:06:44.001104 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-429c8e05-a458-49c1-a77a-7362ffffbe01 req-a9ac2665-0101-438c-a29d-321a08b18623 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/ports?device_id=a591f495-ff59-4865-87ea-c48041ea097f HTTP/1.1" status: 200 len: 210 time: 0.0326061 Jan 05 15:06:44.029650 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-8c7037f5-b833-45ab-9584-1e7cc2ab74b7 service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1114695 Jan 05 15:06:44.091479 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:44.117719 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50149e87-52d5-4480-871b-aabab00581c4 None None] The sync data for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi is: [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '179bc084-ed48-4658-9f6b-af880ff5322a', 'name': '', 'network_id': '1c375b41-1339-4d14-93e7-e473aa7e6978', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'mac_address': 'fa:16:3e:79:6e:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:35Z', 'updated_at': '2022-01-05T14:59:47Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'subnets': [{'id': 'afd427f5-19eb-439b-9825-d3ec4a285d49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:06:44.122750 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-60e92945-4726-4674-99b4-086d530d99e8 req-62fc8c47-66bd-4116-8606-da6db61983ad service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866516 Jan 05 15:06:44.325437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c797bdc3-f7c6-4421-a63a-4119877cc78e None None] New status for floating IP 4359b184-17b1-47c9-80b1-fc623c80beca: DOWN {{(pid=114656) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:06:44.797427 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f3c3e0-d503-423e-9449-1fc33ec65407 req-17e1d293-db2a-4d48-ba25-d7260b5cde4f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:44.798803 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-62f3c3e0-d503-423e-9449-1fc33ec65407 req-17e1d293-db2a-4d48-ba25-d7260b5cde4f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 943 time: 0.0487912 Jan 05 15:06:44.844336 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-62f3c3e0-d503-423e-9449-1fc33ec65407 req-f41f7787-935a-4334-aaa5-68a97f179c03 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400739 Jan 05 15:06:45.155559 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50246) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:45.211437 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.233709 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.356600 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.359216 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.360387 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /v2.0/security-groups/e6bd0ca2-838f-4153-9be5-bb78f57bc543 HTTP/1.1" status: 204 len: 168 time: 0.2037637 Jan 05 15:06:45.363105 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50248) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:45.369715 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6bd0ca2-838f-4153-9be5-bb78f57bc543,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:45.376408 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.api.v2.resource [None req-8edb4a8f-0b1d-48cd-bc07-2814d7bd7226 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] show failed (client error): The resource could not be found. Jan 05 15:06:45.379640 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.379758 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-8edb4a8f-0b1d-48cd-bc07-2814d7bd7226 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "GET /v2.0/security-groups/e6bd0ca2-838f-4153-9be5-bb78f57bc543 HTTP/1.1" status: 404 len: 347 time: 0.0133297 Jan 05 15:06:45.379863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.379863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.379863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.379863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.379863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.379863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.379863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.380459 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.380459 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.380608 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.380863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.381216 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08bb04ca-244e-400a-b825-af0d0e6f018a tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:06:45.381846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50250) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:45.510581 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Deleting port 167d982f-a790-4e3d-bc88-28a8fdd587a5 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:06:45.510919 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.521978 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0513327c-8038-49b0-a926-007e79f1c41c', 'tag': 'b4ef5996-5211-497a-bab8-d83c88eea0df'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:45.524236 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5d7f183-4d6a-42ba-9b87-960020bdfb22" -d '{"events": [{"name": "network-changed", "server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:45.560904 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e x-openstack-request-id: req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:45.561224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:45.561478 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6a5cae84-8a30-4f74-bb80-dad9efdeca7e {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:45.561863 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0513327c-8038-49b0-a926-007e79f1c41c', 'tag': 'b4ef5996-5211-497a-bab8-d83c88eea0df', 'status': 'completed', 'code': 200} Jan 05 15:06:45.591204 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.591537 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.603178 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Calling delete_port for 167d982f-a790-4e3d-bc88-28a8fdd587a5 owned by network:floatingip {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:06:45.703086 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-b2a3e765-2aae-43da-864d-8a59bbada525 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:45.704591 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-b2a3e765-2aae-43da-864d-8a59bbada525 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 1096 time: 0.0903654 Jan 05 15:06:45.834264 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-68ddac49-5d0f-4d76-bbef-e436f4fc194b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:45.835726 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-68ddac49-5d0f-4d76-bbef-e436f4fc194b service neutron] 10.222.0.13 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 915 time: 0.1252687 Jan 05 15:06:45.874788 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-fb187b78-a6b4-47bc-ad87-1f7ca9ecb750 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b4ef5996-5211-497a-bab8-d83c88eea0df HTTP/1.1" status: 200 len: 217 time: 0.0333319 Jan 05 15:06:45.921717 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:45.935276 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-6edec159-5743-4398-aa4d-db577cf4700b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:45.936740 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-6edec159-5743-4398-aa4d-db577cf4700b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=9561926f-aba3-4028-bd06-409215177cc6 HTTP/1.1" status: 200 len: 854 time: 0.0565658 Jan 05 15:06:45.960362 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 req-1db866b9-9eef-4bdc-8283-4f7c19c9990f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:45.961931 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 req-1db866b9-9eef-4bdc-8283-4f7c19c9990f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 943 time: 0.0506546 Jan 05 15:06:45.962671 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Pushing event deleted for resources: {'Port': ['ID=167d982f-a790-4e3d-bc88-28a8fdd587a5,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:45.997137 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-a7ba2c7e-6825-41e2-a4d2-61622d4d1f1e service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=15d9f439-989e-49bd-a540-259f7f374d29&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0431976 Jan 05 15:06:46.010001 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fd5b1de3-8de7-4fed-89ad-1f9832f7d032 req-7e554a74-ddc3-4312-af9d-9b9bf2f2878f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414460 Jan 05 15:06:46.083088 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks [] for floatingip, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:46.085647 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:46.086762 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c434d090-252b-486e-a62f-adc37dfe3bb8 tempest-AttachVolumeShelveTestJSON-961759540 tempest-AttachVolumeShelveTestJSON-961759540-project] 10.222.0.30 "DELETE /v2.0/floatingips/4359b184-17b1-47c9-80b1-fc623c80beca HTTP/1.1" status: 204 len: 168 time: 0.7040534 Jan 05 15:06:46.116638 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-8c16693d-496b-448a-aa77-fdae553c74b5 service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1010177 Jan 05 15:06:46.208269 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a5d7f183-4d6a-42ba-9b87-960020bdfb22 req-4bbd8591-0b39-410e-a7ed-8e932ec286fe service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847983 Jan 05 15:06:46.544339 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b4ef5996-5211-497a-bab8-d83c88eea0df details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:06:46.554358 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:06:46.577790 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 0d57813b-5531-41c7-8d8d-8b2fc393b843 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:06:46.578196 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 0d57813b-5531-41c7-8d8d-8b2fc393b843 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:06:46.658144 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b4ef5996-5211-497a-bab8-d83c88eea0df, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b4ef5996-5211-497a-bab8-d83c88eea0df,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:46.672565 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': 'b4ef5996-5211-497a-bab8-d83c88eea0df', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'port_id': 'b4ef5996-5211-497a-bab8-d83c88eea0df', 'mac_address': 'fa:16:3e:73:88:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9561926f-aba3-4028-bd06-409215177cc6', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:06:46.708854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:46.721828 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b4ef5996-5211-497a-bab8-d83c88eea0df {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:06:46.741293 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b4ef5996-5211-497a-bab8-d83c88eea0df, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b4ef5996-5211-497a-bab8-d83c88eea0df,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:46.842571 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:46.888199 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=b4ef5996-5211-497a-bab8-d83c88eea0df,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:47.131217 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfff50f-7bce-47b4-98fd-25be4b254cde req-8cfdd0d0-aa0c-4b1c-a286-d6d9941f2a6e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:47.132669 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9cfff50f-7bce-47b4-98fd-25be4b254cde req-8cfdd0d0-aa0c-4b1c-a286-d6d9941f2a6e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 944 time: 0.0538869 Jan 05 15:06:47.177932 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['b4ef5996-5211-497a-bab8-d83c88eea0df'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:06:47.180247 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9cfff50f-7bce-47b4-98fd-25be4b254cde req-739751ab-6eb6-45ae-b7ee-f95dafcc5dab tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410535 Jan 05 15:06:48.295568 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e5b86d-b701-41bb-a118-b5cd9179edef req-4f65b23d-ae44-49bf-9cab-8a506b46e936 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:48.297158 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c2e5b86d-b701-41bb-a118-b5cd9179edef req-4f65b23d-ae44-49bf-9cab-8a506b46e936 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 944 time: 0.0516243 Jan 05 15:06:48.346684 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c2e5b86d-b701-41bb-a118-b5cd9179edef req-7e2ede74-ed3c-4ee9-b2c5-3e5a7480feba tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437732 Jan 05 15:06:48.526380 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b4ef5996-5211-497a-bab8-d83c88eea0df up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:06:48.624828 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port b4ef5996-5211-497a-bab8-d83c88eea0df completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:06:48.628578 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port b4ef5996-5211-497a-bab8-d83c88eea0df triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:06:48.628938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:48.706721 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:48.732567 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0513327c-8038-49b0-a926-007e79f1c41c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4ef5996-5211-497a-bab8-d83c88eea0df'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:06:48.737944 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e8d290b-8950-4a09-90d8-b1d559c298c5" -d '{"events": [{"server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "name": "network-vif-plugged", "status": "completed", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:06:48.748759 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port b4ef5996-5211-497a-bab8-d83c88eea0df, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b4ef5996-5211-497a-bab8-d83c88eea0df,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:48.770783 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:06:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-237757d2-b49d-4c52-88e2-17bcb71c1655 x-openstack-request-id: req-237757d2-b49d-4c52-88e2-17bcb71c1655 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:06:48.771070 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "name": "network-vif-plugged", "status": "completed", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:06:48.771406 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-237757d2-b49d-4c52-88e2-17bcb71c1655 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:06:48.771796 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0513327c-8038-49b0-a926-007e79f1c41c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4ef5996-5211-497a-bab8-d83c88eea0df', 'code': 200} Jan 05 15:06:48.803841 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50282) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:48.811792 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:48.864604 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=b4ef5996-5211-497a-bab8-d83c88eea0df,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:49.148086 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f5a44c-88c8-4112-b0bd-0a0126b7e85c req-fd777b02-92d2-4522-af15-6272db0cd730 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:49.149594 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f5a44c-88c8-4112-b0bd-0a0126b7e85c req-fd777b02-92d2-4522-af15-6272db0cd730 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 1098 time: 0.0748956 Jan 05 15:06:49.211799 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-73f5a44c-88c8-4112-b0bd-0a0126b7e85c req-c799e040-9e9e-4a6c-aeb0-e70d0d654389 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538554 Jan 05 15:06:49.256484 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:49.490460 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026aa699-849b-46bb-baf2-888fb97cde2e req-8e509f6f-ceca-4cac-b1f8-061e30d0b651 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:49.491851 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-026aa699-849b-46bb-baf2-888fb97cde2e req-8e509f6f-ceca-4cac-b1f8-061e30d0b651 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 945 time: 0.0776255 Jan 05 15:06:49.561568 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-026aa699-849b-46bb-baf2-888fb97cde2e req-e120af1e-d1d0-4d04-99e3-5d3b6949f919 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514944 Jan 05 15:06:49.570650 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Deleting port 179bc084-ed48-4658-9f6b-af880ff5322a {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:06:49.570987 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:49.656876 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] For port 179bc084-ed48-4658-9f6b-af880ff5322a, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=179bc084-ed48-4658-9f6b-af880ff5322a,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:49.657266 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:49.670021 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Calling delete_port for 179bc084-ed48-4658-9f6b-af880ff5322a owned by network:router_interface {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:06:49.916696 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:49.946945 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Pushing event deleted for resources: {'Port': ['ID=179bc084-ed48-4658-9f6b-af880ff5322a,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:50.106033 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:50.320850 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Router 9ec87e52-56d6-4808-9eb4-61d2fe146230 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:06:50.427351 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:06:50.432644 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-094e8f35-250a-4279-bb9c-d8029684d8a0 admin admin] 10.222.0.30 "PUT /v2.0/routers/9ec87e52-56d6-4808-9eb4-61d2fe146230/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6274769 Jan 05 15:06:50.435256 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50288) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:50.436310 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] Sync routers for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:06:50.446298 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:06:50.447207 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:06:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:50.539673 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks [] for router, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:50.554077 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:06:50.647429 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:50.686067 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e req-21cf7aa5-8e51-4663-ba2e-9be72276939e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:06:50.687671 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e req-21cf7aa5-8e51-4663-ba2e-9be72276939e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 945 time: 0.0574603 Jan 05 15:06:50.735965 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d2233c73-9dfe-491b-8e1a-ab8fdda2444e req-9eaf48c5-a6e0-4853-aa4c-dbc72041a25d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425429 Jan 05 15:06:50.743046 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58'}], 'enable_snat': True}, 'gw_port_id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T15:06:49Z', 'revision_number': 5, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port': {'id': '620ad2a4-14a0-4247-bbce-da5c4a989c40', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:55:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.58', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T14:59:27Z', 'updated_at': '2022-01-05T14:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:50.766249 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Deleting port 620ad2a4-14a0-4247-bbce-da5c4a989c40 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:06:50.766550 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:50.770386 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] Checking router: 9ec87e52-56d6-4808-9eb4-61d2fe146230 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:06:50.779392 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] Routers {'9ec87e52-56d6-4808-9eb4-61d2fe146230'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:06:50.779994 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:06:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['9ec87e52-56d6-4808-9eb4-61d2fe146230'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:50.855146 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] For port 620ad2a4-14a0-4247-bbce-da5c4a989c40, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=620ad2a4-14a0-4247-bbce-da5c4a989c40,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:50.855831 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:50.867878 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] Set router 9ec87e52-56d6-4808-9eb4-61d2fe146230 gateway port host: None {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:06:50.868579 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Calling delete_port for 620ad2a4-14a0-4247-bbce-da5c4a989c40 owned by network:router_gateway {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:06:50.922927 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T15:06:50Z', 'revision_number': 6, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:51.040789 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7b30190-9980-4088-b02e-baaef4c8e3fe None None] The sync data for ids ['9ec87e52-56d6-4808-9eb4-61d2fe146230'] in dv-cinder-master-3-iscsi is: [{'id': '9ec87e52-56d6-4808-9eb4-61d2fe146230', 'name': 'tempest-AttachVolumeShelveTestJSON-1164897801-router', 'tenant_id': 'f4a45a70c5d046238abaad07fbe529e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T14:59:26Z', 'updated_at': '2022-01-05T15:06:50Z', 'revision_number': 6, 'project_id': 'f4a45a70c5d046238abaad07fbe529e9', 'gw_port_host': None}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:06:51.046619 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:06:51.099595 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.123347 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Pushing event deleted for resources: {'Port': ['ID=620ad2a4-14a0-4247-bbce-da5c4a989c40,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:51.184223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.271899 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.274024 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.645816 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.646306 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9ec87e52-56d6-4808-9eb4-61d2fe146230 {{(pid=114654) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:06:51.650479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.651614 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-18715b7f-5fc2-4417-bdeb-fd71e2f35b09 admin admin] 10.222.0.30 "DELETE /v2.0/routers/9ec87e52-56d6-4808-9eb4-61d2fe146230 HTTP/1.1" status: 204 len: 168 time: 1.2154458 Jan 05 15:06:51.654218 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50298) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:51.697899 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_v2 [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] Deleting subnet afd427f5-19eb-439b-9825-d3ec4a285d49 {{(pid=114654) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:06:51.701257 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.736809 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8770652'] for subnet, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.831748 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.945767 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8855717', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8833888'] for subnet, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.972202 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=afd427f5-19eb-439b-9825-d3ec4a285d49,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:51.975957 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:51.979573 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-5fc73318-7bde-43b2-8df7-a7463332bbe1 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/afd427f5-19eb-439b-9825-d3ec4a285d49 HTTP/1.1" status: 204 len: 168 time: 0.3243339 Jan 05 15:06:51.984043 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50300) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:51.986847 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-627d74e6-0316-4445-ac0f-be92d5c5f5b3 None None] Network 1c375b41-1339-4d14-93e7-e473aa7e6978 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:06:52.057038 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.118162 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Deleting port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:06:52.118744 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.176116 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] DHCP port deletion for 1c375b41-1339-4d14-93e7-e473aa7e6978 request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:06:52.198027 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] For port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:52.198378 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.202629 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 179bc084-ed48-4658-9f6b-af880ff5322a no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:06:52.211602 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Calling delete_port for 6bf4317f-dc27-4f96-8b94-f8059ce91f4a owned by network:dhcp {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:06:52.225607 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 179bc084-ed48-4658-9f6b-af880ff5322a {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:06:52.225948 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 179bc084-ed48-4658-9f6b-af880ff5322a not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:06:52.226363 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 620ad2a4-14a0-4247-bbce-da5c4a989c40 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:06:52.251887 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 620ad2a4-14a0-4247-bbce-da5c4a989c40 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:06:52.252229 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 620ad2a4-14a0-4247-bbce-da5c4a989c40 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:06:52.268239 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] Deleting port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:06:52.268634 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.411409 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.436681 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Pushing event deleted for resources: {'Port': ['ID=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:52.438805 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] No DVR routers for this DVR port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a on host dv-cinder-master-3-iscsi {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:06:52.474602 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] For port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,segment=NetworkSegment(6c95c843-d01b-4253-a6ef-82805037a6f7),segment_id=6c95c843-d01b-4253-a6ef-82805037a6f7)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:06:52.475005 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.488679 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] Calling delete_port for 6bf4317f-dc27-4f96-8b94-f8059ce91f4a owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:06:52.522537 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.546586 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1c375b41-1339-4d14-93e7-e473aa7e6978']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:52.556684 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6c95c843-d01b-4253-a6ef-82805037a6f7') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:52.556981 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6c95c843-d01b-4253-a6ef-82805037a6f7') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:06:52.567516 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.577836 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.586938 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.591848 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Releasing vlan 145 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:06:52.592233 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:06:52.593918 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:06:52.604007 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] Pushing event deleted for resources: {'Port': ['ID=6bf4317f-dc27-4f96-8b94-f8059ce91f4a,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:52.607808 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37a84f2b-fdb8-447b-af20-20306fafd4cf None None] No DVR routers for this DVR port 6bf4317f-dc27-4f96-8b94-f8059ce91f4a on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:06:52.733944 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.738568 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:52.742328 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] 10.222.0.30 "DELETE /v2.0/networks/1c375b41-1339-4d14-93e7-e473aa7e6978 HTTP/1.1" status: 204 len: 168 time: 0.7573419 Jan 05 15:06:52.756185 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67e3d4ca-e50d-40cf-84a3-49f56f374bc0 admin admin] Pushing event deleted for resources: {'Network': ['ID=1c375b41-1339-4d14-93e7-e473aa7e6978,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:53.248327 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50314) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:53.286800 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-20006919-3f41-4fc1-b183-7d8194db3c46 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f4a45a70c5d046238abaad07fbe529e9&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0373285 Jan 05 15:06:53.289212 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50316) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:53.335167 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a06ee290-9d0a-4d19-bd6b-c8b92be3482c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:53.360612 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a06ee290-9d0a-4d19-bd6b-c8b92be3482c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:53.487869 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a06ee290-9d0a-4d19-bd6b-c8b92be3482c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:53.490534 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a06ee290-9d0a-4d19-bd6b-c8b92be3482c admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:53.491696 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a06ee290-9d0a-4d19-bd6b-c8b92be3482c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9eb21158-42db-4023-a3d1-404639319159 HTTP/1.1" status: 204 len: 168 time: 0.2016075 Jan 05 15:06:53.499732 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06ee290-9d0a-4d19-bd6b-c8b92be3482c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9eb21158-42db-4023-a3d1-404639319159,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:54.126133 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6bf4317f-dc27-4f96-8b94-f8059ce91f4a no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:06:54.146667 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 6bf4317f-dc27-4f96-8b94-f8059ce91f4a {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:06:54.146888 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6bf4317f-dc27-4f96-8b94-f8059ce91f4a not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:06:56.328498 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50376) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:56.428934 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5d0e0045-316a-47f7-b189-94ffaad25194 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:56.500836 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5d0e0045-316a-47f7-b189-94ffaad25194 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:56.585286 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5d0e0045-316a-47f7-b189-94ffaad25194 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:56.624087 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5d0e0045-316a-47f7-b189-94ffaad25194 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b7afcb105a3c45368612aa019f475269&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2943981 Jan 05 15:06:56.624939 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0e0045-316a-47f7-b189-94ffaad25194 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5e2650b-0ace-43ae-948c-f135c40f71cb,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:56.626814 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50382) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:56.673834 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7481acff-2f2d-41e7-b0d5-dabc50501372 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:56.694247 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7481acff-2f2d-41e7-b0d5-dabc50501372 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:56.796272 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7481acff-2f2d-41e7-b0d5-dabc50501372 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:56.798931 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7481acff-2f2d-41e7-b0d5-dabc50501372 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:56.800111 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7481acff-2f2d-41e7-b0d5-dabc50501372 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a5e2650b-0ace-43ae-948c-f135c40f71cb HTTP/1.1" status: 204 len: 168 time: 0.1721456 Jan 05 15:06:56.807838 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7481acff-2f2d-41e7-b0d5-dabc50501372 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5e2650b-0ace-43ae-948c-f135c40f71cb,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:57.408389 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50388) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:57.423055 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-afcee6a1-c03f-4a11-b2fd-80fcccbdd0d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:57.496161 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-afcee6a1-c03f-4a11-b2fd-80fcccbdd0d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:57.608160 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-afcee6a1-c03f-4a11-b2fd-80fcccbdd0d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:57.644794 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcee6a1-c03f-4a11-b2fd-80fcccbdd0d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0342656-0748-4d15-bbae-7b1a26f78257,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:57.649173 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-afcee6a1-c03f-4a11-b2fd-80fcccbdd0d0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5255b64f59854e82b61fc15ab0951ce9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2396982 Jan 05 15:06:57.652811 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50392) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:06:57.704325 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe0014cc-1ad5-478d-8120-41045dc371e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:57.725335 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe0014cc-1ad5-478d-8120-41045dc371e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:57.853575 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe0014cc-1ad5-478d-8120-41045dc371e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:57.856191 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fe0014cc-1ad5-478d-8120-41045dc371e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:06:57.857371 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-fe0014cc-1ad5-478d-8120-41045dc371e2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c0342656-0748-4d15-bbae-7b1a26f78257 HTTP/1.1" status: 204 len: 168 time: 0.2041299 Jan 05 15:06:57.865008 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0014cc-1ad5-478d-8120-41045dc371e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0342656-0748-4d15-bbae-7b1a26f78257,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:06:58.259534 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-70916014-a28f-4399-86dc-293bf0da1220 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:00.425018 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-528d95d4-d205-406b-a84c-25835f737982 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:01.845659 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:02.739422 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:03.567792 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:03.790114 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4184858c-2338-4108-91da-6bc09144ee7c req-9e80baad-f7e5-423c-9602-0ad840088f39 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:03.791567 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-9e80baad-f7e5-423c-9602-0ad840088f39 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.1062672 Jan 05 15:07:03.806683 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-5f80c7d6-d79e-46a1-82a4-75e42460f0f6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/quotas/97821d0c0c79446abba323f103c8244a HTTP/1.1" status: 200 len: 375 time: 0.0090909 Jan 05 15:07:03.860404 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-0d6e2155-fd2a-4a0c-8fe5-94a31f5d1482 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0482516 Jan 05 15:07:03.953834 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-2eeade1e-9b16-452a-9eda-82f0f1d7b43f service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863688 Jan 05 15:07:04.041803 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-c6be48f6-8da7-4671-9528-83540526b58c service neutron] 10.222.0.30 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824480 Jan 05 15:07:04.321039 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-360406b0-f8c2-47e0-99ef-25bb42df0068 req-5450c231-10b9-4010-b805-41d324a19cf0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 210 time: 0.0253923 Jan 05 15:07:04.422752 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.340842 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50536) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:05.421974 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4b0710ec-d3dc-40bf-b14d-f29161ac9caa req-2f078085-576c-46df-a307-6652b1aad3d2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 210 time: 0.0329561 Jan 05 15:07:05.455189 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f2387d08-d9ae-4731-a684-9e84e7432fb4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.530323 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f2387d08-d9ae-4731-a684-9e84e7432fb4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.605262 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f2387d08-d9ae-4731-a684-9e84e7432fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.643489 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f2387d08-d9ae-4731-a684-9e84e7432fb4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6405756f0cd640b89365e5cf31682ecb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3015099 Jan 05 15:07:05.645568 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2387d08-d9ae-4731-a684-9e84e7432fb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6eafb66d-0c43-4f90-a87e-4175ad48f9a9,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:05.646166 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50542) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:05.695828 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-19e49eab-fa9b-4b77-ac66-f8a5ae26b73b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.719625 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-19e49eab-fa9b-4b77-ac66-f8a5ae26b73b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.841898 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-19e49eab-fa9b-4b77-ac66-f8a5ae26b73b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.844470 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-19e49eab-fa9b-4b77-ac66-f8a5ae26b73b admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:05.845645 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-19e49eab-fa9b-4b77-ac66-f8a5ae26b73b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6eafb66d-0c43-4f90-a87e-4175ad48f9a9 HTTP/1.1" status: 204 len: 168 time: 0.1985154 Jan 05 15:07:05.853612 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19e49eab-fa9b-4b77-ac66-f8a5ae26b73b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6eafb66d-0c43-4f90-a87e-4175ad48f9a9,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:06.447670 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4184858c-2338-4108-91da-6bc09144ee7c req-a26c41e2-6b94-4636-a558-dd19d30e1547 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:06.450094 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-a26c41e2-6b94-4636-a558-dd19d30e1547 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/networks?id=15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 200 len: 814 time: 0.0974092 Jan 05 15:07:06.497308 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Request body: {'port': {'device_id': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'admin_state_up': True, 'tenant_id': '97821d0c0c79446abba323f103c8244a'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:07:06.517891 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-947873c5-fe7a-460f-bbd3-ab6c21ef888c req-457dcc46-cffb-459b-be91-73a3ea4ccba8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 210 time: 0.0289347 Jan 05 15:07:06.566491 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50550) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:06.579969 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5f18b9f1-3094-4dd8-b88e-c1b740b99cf2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:06.652650 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5f18b9f1-3094-4dd8-b88e-c1b740b99cf2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:06.702911 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Made reservation on behalf of 97821d0c0c79446abba323f103c8244a for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:07:06.706655 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:06.737017 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5f18b9f1-3094-4dd8-b88e-c1b740b99cf2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:06.773479 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f18b9f1-3094-4dd8-b88e-c1b740b99cf2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc8b399c-9f0f-40d2-82fb-4587b3e66540,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:06.780703 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5f18b9f1-3094-4dd8-b88e-c1b740b99cf2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=10d17e1bcd3b44078e43d754ce6d44dd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2103021 Jan 05 15:07:06.780703 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50552) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:06.827371 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2efe34b2-7118-4620-882c-fcf6c251d212 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:06.841341 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Allocated IP 172.20.0.12 (15d9f439-989e-49bd-a540-259f7f374d29/9561926f-aba3-4028-bd06-409215177cc6/32e08202-b8ca-4301-9648-36aacfa35c0a) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:07:06.850913 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2efe34b2-7118-4620-882c-fcf6c251d212 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:06.986686 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:06.999616 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2efe34b2-7118-4620-882c-fcf6c251d212 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:07.002251 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2efe34b2-7118-4620-882c-fcf6c251d212 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:07.003398 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2efe34b2-7118-4620-882c-fcf6c251d212 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/cc8b399c-9f0f-40d2-82fb-4587b3e66540 HTTP/1.1" status: 204 len: 168 time: 0.2220993 Jan 05 15:07:07.011309 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2efe34b2-7118-4620-882c-fcf6c251d212 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc8b399c-9f0f-40d2-82fb-4587b3e66540,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:07.200326 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:07.239086 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', '13cea986-c954-4f2a-80f4-f2a459e8a695', 'b4ef5996-5211-497a-bab8-d83c88eea0df'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:07:07.248462 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Network 15d9f439-989e-49bd-a540-259f7f374d29 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:07:07.251929 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:07:07.255641 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:07:07.288589 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event updated for resources: {'Port': ['ID=32e08202-b8ca-4301-9648-36aacfa35c0a,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:07.312071 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:07.312678 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:07.414033 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-52b0712a-2f2a-46b6-b2e3-6afd3909371e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9247346 Jan 05 15:07:07.438302 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Request body: {'port': {'device_id': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:07:07.498983 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:07.732292 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609b7693-3550-4f37-bbe5-796d8abfd1a3 req-e9c6fab7-d04e-43c7-aec1-f04d6ebf1ad7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:07.733794 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-609b7693-3550-4f37-bbe5-796d8abfd1a3 req-e9c6fab7-d04e-43c7-aec1-f04d6ebf1ad7 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 932 time: 0.1019452 Jan 05 15:07:07.807543 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-609b7693-3550-4f37-bbe5-796d8abfd1a3 req-9ad49430-8d1c-4316-bb69-0545cb76d379 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654442 Jan 05 15:07:07.866187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 32e08202-b8ca-4301-9648-36aacfa35c0a {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:07:07.874067 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:07.885638 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Transition to ACTIVE for port object 32e08202-b8ca-4301-9648-36aacfa35c0a will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:07:07.956692 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:08.016921 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Pushing event updated for resources: {'Port': ['ID=32e08202-b8ca-4301-9648-36aacfa35c0a,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:08.079227 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Attempting to bind port 32e08202-b8ca-4301-9648-36aacfa35c0a on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:07:08.079564 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Attempting to bind port 32e08202-b8ca-4301-9648-36aacfa35c0a by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:07:08.079888 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Attempting to bind port 32e08202-b8ca-4301-9648-36aacfa35c0a on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:07:08.084086 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Port 32e08202-b8ca-4301-9648-36aacfa35c0a on network 15d9f439-989e-49bd-a540-259f7f374d29 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:07:08.084595 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Attempting to bind port 32e08202-b8ca-4301-9648-36aacfa35c0a on network 15d9f439-989e-49bd-a540-259f7f374d29 {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:07:08.089308 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 7, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:07:08.089667 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Checking segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:07:08.090047 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Bound using segment: {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:07:08.090464 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Bound port: 32e08202-b8ca-4301-9648-36aacfa35c0a, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '88c3102d-b3ce-4ec1-8d0d-61de3749ce55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:07:08.090810 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:08.160283 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] For port 32e08202-b8ca-4301-9648-36aacfa35c0a, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:07:08.160283 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] For port 32e08202-b8ca-4301-9648-36aacfa35c0a, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e08202-b8ca-4301-9648-36aacfa35c0a,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:07:08.282867 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:08.321796 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:08.322410 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:08.323771 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] 10.222.0.13 "PUT /v2.0/ports/32e08202-b8ca-4301-9648-36aacfa35c0a HTTP/1.1" status: 200 len: 1094 time: 0.8907335 Jan 05 15:07:08.324213 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'tag': '32e08202-b8ca-4301-9648-36aacfa35c0a'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:07:08.326547 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd" -d '{"events": [{"name": "network-changed", "server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:07:08.350987 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-907dfc93-b97b-4476-9566-c1ab50bf4844 service neutron] Pushing event updated for resources: {'Port': ['ID=32e08202-b8ca-4301-9648-36aacfa35c0a,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:08.364103 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:07:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ea0b462-b587-46bd-895b-fb87e8ded62c x-openstack-request-id: req-3ea0b462-b587-46bd-895b-fb87e8ded62c {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:07:08.364394 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:07:08.364647 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3ea0b462-b587-46bd-895b-fb87e8ded62c {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:07:08.365040 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'tag': '32e08202-b8ca-4301-9648-36aacfa35c0a', 'status': 'completed', 'code': 200} Jan 05 15:07:08.450737 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-5d4b048b-bb0a-4dc2-9095-fff541df0112 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:08.452396 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-5d4b048b-bb0a-4dc2-9095-fff541df0112 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 1097 time: 0.0414026 Jan 05 15:07:08.556325 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-abd44df0-6071-41cb-acdc-3ef9f9423640 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:08.557879 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-abd44df0-6071-41cb-acdc-3ef9f9423640 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=97821d0c0c79446abba323f103c8244a&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0915906 Jan 05 15:07:08.659006 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-0c822770-6c3c-4c8a-bbc7-246084f35879 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:08.660463 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-50ff12c3-6cdc-40e9-9716-ff40ba35d5bd req-0c822770-6c3c-4c8a-bbc7-246084f35879 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0957711 Jan 05 15:07:08.759660 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4184858c-2338-4108-91da-6bc09144ee7c req-135993ea-4df4-4051-87df-7e8da50f7f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:08.761252 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-135993ea-4df4-4051-87df-7e8da50f7f05 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=97821d0c0c79446abba323f103c8244a&device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 1097 time: 0.0410917 Jan 05 15:07:08.815736 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-4794145b-5a08-4178-9cda-93d01b3f0214 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=32e08202-b8ca-4301-9648-36aacfa35c0a HTTP/1.1" status: 200 len: 217 time: 0.0371692 Jan 05 15:07:08.866428 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4184858c-2338-4108-91da-6bc09144ee7c req-8a22fe50-87fa-446d-985c-318aeefe444d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:08.867963 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-8a22fe50-87fa-446d-985c-318aeefe444d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=9561926f-aba3-4028-bd06-409215177cc6 HTTP/1.1" status: 200 len: 854 time: 0.0461261 Jan 05 15:07:08.921050 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-eeda76f9-84d2-4b04-bb39-1c2f79c0cd4c service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=15d9f439-989e-49bd-a540-259f7f374d29&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0434067 Jan 05 15:07:08.961800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d159c8-cba6-49c2-ba93-5633ad36106f req-be9782dc-82c3-4f0f-aad5-5840537f3a6f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:08.963237 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17d159c8-cba6-49c2-ba93-5633ad36106f req-be9782dc-82c3-4f0f-aad5-5840537f3a6f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 944 time: 0.0780451 Jan 05 15:07:09.059917 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-17d159c8-cba6-49c2-ba93-5633ad36106f req-cb7761e5-3ec4-4b2b-a085-e4b6d870dcf0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688329 Jan 05 15:07:09.061913 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-606201e8-b662-4020-b933-11b2d243e0e0 service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304359 Jan 05 15:07:09.155367 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4184858c-2338-4108-91da-6bc09144ee7c req-f22fc070-19e7-427f-a052-b1114cee0e31 service neutron] 10.222.0.13 "GET /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865533 Jan 05 15:07:10.186203 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3036e5bf-29e8-4fbd-a132-92cd569993e4 req-08826055-9eb8-4897-88f7-f5d8ebb1b76b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:10.187678 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3036e5bf-29e8-4fbd-a132-92cd569993e4 req-08826055-9eb8-4897-88f7-f5d8ebb1b76b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 944 time: 0.0591590 Jan 05 15:07:10.234513 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3036e5bf-29e8-4fbd-a132-92cd569993e4 req-d28ba478-30f0-4bde-90b3-88f1163f8962 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413513 Jan 05 15:07:11.354555 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae848ae-b238-4df4-97bf-0b0f49e08653 req-ce8d5ede-eeac-4949-9ac7-b35d83d8be9a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:11.356500 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cae848ae-b238-4df4-97bf-0b0f49e08653 req-ce8d5ede-eeac-4949-9ac7-b35d83d8be9a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 944 time: 0.0524120 Jan 05 15:07:11.404454 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cae848ae-b238-4df4-97bf-0b0f49e08653 req-d4bf409a-ec63-47b7-a429-54c3bb4ec477 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424139 Jan 05 15:07:12.519051 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca req-5201fee5-581c-4c57-b4b6-f071d3e44cc2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:12.520519 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca req-5201fee5-581c-4c57-b4b6-f071d3e44cc2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 944 time: 0.0500343 Jan 05 15:07:12.569557 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f8b6d643-e7a9-44ce-ba62-a1bf3b81d2ca req-f61a72af-e47f-4611-bb0c-a7e92d121e0e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431995 Jan 05 15:07:12.645027 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e08202-b8ca-4301-9648-36aacfa35c0a details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:07:12.740633 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 32e08202-b8ca-4301-9648-36aacfa35c0a, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e08202-b8ca-4301-9648-36aacfa35c0a,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:07:12.751826 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '32e08202-b8ca-4301-9648-36aacfa35c0a', 'network_id': '15d9f439-989e-49bd-a540-259f7f374d29', 'port_id': '32e08202-b8ca-4301-9648-36aacfa35c0a', 'mac_address': 'fa:16:3e:07:b2:23', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9561926f-aba3-4028-bd06-409215177cc6', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:07:12.798559 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:12.811890 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32e08202-b8ca-4301-9648-36aacfa35c0a {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:07:12.831631 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 32e08202-b8ca-4301-9648-36aacfa35c0a, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e08202-b8ca-4301-9648-36aacfa35c0a,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:07:12.915856 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:12.964742 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=32e08202-b8ca-4301-9648-36aacfa35c0a,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:13.289922 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['32e08202-b8ca-4301-9648-36aacfa35c0a'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:07:13.681642 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 req-051b38d0-af4e-4ad9-a5b6-87c8e04aae3d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:13.683112 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 req-051b38d0-af4e-4ad9-a5b6-87c8e04aae3d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 945 time: 0.0481486 Jan 05 15:07:13.736256 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2ee4c96b-22f9-4a32-9747-a44cb2e4d652 req-588cc95b-684d-43e1-b836-701b28376c35 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476422 Jan 05 15:07:14.145204 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50644) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:14.245580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-84f3fd6f-1f54-4ba3-98e4-394d32228d8a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.314509 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-84f3fd6f-1f54-4ba3-98e4-394d32228d8a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.376546 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-84f3fd6f-1f54-4ba3-98e4-394d32228d8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.413465 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f3fd6f-1f54-4ba3-98e4-394d32228d8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3328efa3-05bd-426d-b7ae-a149bfc59c1f,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:14.417611 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-84f3fd6f-1f54-4ba3-98e4-394d32228d8a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=149e87c167754232a0b52d8f8fb076c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2713969 Jan 05 15:07:14.421059 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50648) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:14.470138 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-02cf47e5-8819-4e90-a501-17e3484cf176 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.490951 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-02cf47e5-8819-4e90-a501-17e3484cf176 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.636301 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-02cf47e5-8819-4e90-a501-17e3484cf176 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.638969 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-02cf47e5-8819-4e90-a501-17e3484cf176 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.640113 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-02cf47e5-8819-4e90-a501-17e3484cf176 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3328efa3-05bd-426d-b7ae-a149bfc59c1f HTTP/1.1" status: 204 len: 168 time: 0.2181647 Jan 05 15:07:14.647872 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02cf47e5-8819-4e90-a501-17e3484cf176 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3328efa3-05bd-426d-b7ae-a149bfc59c1f,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:14.666315 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e08202-b8ca-4301-9648-36aacfa35c0a up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:07:14.790392 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 32e08202-b8ca-4301-9648-36aacfa35c0a completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:07:14.795028 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 32e08202-b8ca-4301-9648-36aacfa35c0a triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:07:14.796907 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.850746 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 req-384e9d0d-5537-4057-872c-25924920a3af tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:14.852804 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 req-384e9d0d-5537-4057-872c-25924920a3af tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 945 time: 0.0515692 Jan 05 15:07:14.879313 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:14.900234 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0c5e73a6-c283-46e8-88dc-3266ed9822e7 req-f9fb50c6-4298-44ff-be3e-3bb1b4cb909d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418289 Jan 05 15:07:14.904198 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32e08202-b8ca-4301-9648-36aacfa35c0a'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:07:14.906472 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41c1932b-bb52-412a-8197-63a77a2d03d2" -d '{"events": [{"server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "name": "network-vif-plugged", "status": "completed", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:07:14.927392 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 32e08202-b8ca-4301-9648-36aacfa35c0a, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e08202-b8ca-4301-9648-36aacfa35c0a,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:07:14.942942 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:07:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2619a535-a042-44e6-afcc-9604efd8695f x-openstack-request-id: req-2619a535-a042-44e6-afcc-9604efd8695f {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:07:14.943234 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "name": "network-vif-plugged", "status": "completed", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:07:14.943487 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2619a535-a042-44e6-afcc-9604efd8695f {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:07:14.943882 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32e08202-b8ca-4301-9648-36aacfa35c0a', 'code': 200} Jan 05 15:07:14.982142 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.032873 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=32e08202-b8ca-4301-9648-36aacfa35c0a,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:15.231631 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50658) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:15.245018 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-285ed253-9992-4654-9f1a-8992b00af7bc admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.323365 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-285ed253-9992-4654-9f1a-8992b00af7bc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.334592 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5db6ed3-0048-4621-ad34-d1fe400cb5c5 req-e2c124e8-fc50-48ad-b546-d856bc22ee7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:15.336070 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b5db6ed3-0048-4621-ad34-d1fe400cb5c5 req-e2c124e8-fc50-48ad-b546-d856bc22ee7c service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 1099 time: 0.0391104 Jan 05 15:07:15.380830 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b5db6ed3-0048-4621-ad34-d1fe400cb5c5 req-cc022294-07ec-4885-8026-76120db2983b service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368640 Jan 05 15:07:15.413202 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-285ed253-9992-4654-9f1a-8992b00af7bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.452161 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-285ed253-9992-4654-9f1a-8992b00af7bc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=76b8833dfe1f4e8b8c1cb35cb035d4e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2194784 Jan 05 15:07:15.453110 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285ed253-9992-4654-9f1a-8992b00af7bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d58b0f64-24fe-45d0-ae1f-55d70b43fd7f,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:15.454926 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50660) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:15.502691 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2d4c8673-9766-4d2a-9599-3342a2f2f102 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.523681 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2d4c8673-9766-4d2a-9599-3342a2f2f102 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.635952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2d4c8673-9766-4d2a-9599-3342a2f2f102 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.638568 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2d4c8673-9766-4d2a-9599-3342a2f2f102 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:15.639695 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2d4c8673-9766-4d2a-9599-3342a2f2f102 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d58b0f64-24fe-45d0-ae1f-55d70b43fd7f HTTP/1.1" status: 204 len: 168 time: 0.1837344 Jan 05 15:07:15.647385 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4c8673-9766-4d2a-9599-3342a2f2f102 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d58b0f64-24fe-45d0-ae1f-55d70b43fd7f,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:16.012653 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9023b180-614d-4060-97d5-25560247e1e6 req-05056f5f-84e7-44bc-8b78-b0c9c00d7ec4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:16.014148 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9023b180-614d-4060-97d5-25560247e1e6 req-05056f5f-84e7-44bc-8b78-b0c9c00d7ec4 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0485947 Jan 05 15:07:16.060333 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9023b180-614d-4060-97d5-25560247e1e6 req-e56d58dc-bf82-4da7-baba-d37e5170d448 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407629 Jan 05 15:07:17.173817 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9597083-423e-4f8c-99a9-3c19566ac4c7 req-01c8fb98-4362-4a53-980d-6fd4fcca0656 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:17.175287 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d9597083-423e-4f8c-99a9-3c19566ac4c7 req-01c8fb98-4362-4a53-980d-6fd4fcca0656 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0482063 Jan 05 15:07:17.221390 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d9597083-423e-4f8c-99a9-3c19566ac4c7 req-df429741-8b39-4ca9-8fd5-5c06e20bf01f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405114 Jan 05 15:07:28.045685 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:07:28.418802 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-478f543c-8555-40c8-980d-8f5eb6741146 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:30.412898 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a11fad23-7177-4bec-b0e8-34e437c98152 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:31.847225 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:32.455495 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdfc9777-f51d-4910-934d-831573233a5d req-e8cce59c-b3a0-45f4-b1b2-bbc0d3787bb0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:32.456835 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fdfc9777-f51d-4910-934d-831573233a5d req-e8cce59c-b3a0-45f4-b1b2-bbc0d3787bb0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0467856 Jan 05 15:07:32.506503 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-fdfc9777-f51d-4910-934d-831573233a5d req-09e31ef2-c61b-4218-bd36-72247359fb42 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440521 Jan 05 15:07:32.721437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:33.612789 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:33.624548 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dafb71e9-9953-498e-961b-ae99f42c4b58 req-5d52de26-4df5-4d09-8151-cd2fe09997aa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:33.626085 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dafb71e9-9953-498e-961b-ae99f42c4b58 req-5d52de26-4df5-4d09-8151-cd2fe09997aa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0493941 Jan 05 15:07:33.674235 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dafb71e9-9953-498e-961b-ae99f42c4b58 req-aa5cc9ed-792d-4e6d-8529-2148e63dd6d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424771 Jan 05 15:07:34.395478 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:34.462388 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-5755833c-225b-41a5-ab58-782d03a7308a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:34.463845 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-5755833c-225b-41a5-ab58-782d03a7308a tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0509887 Jan 05 15:07:34.785420 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2de4c32f-a0ec-472c-9e36-08c732aeb158 req-0c37f70d-042d-4406-b382-e1690ec9cf1d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:34.786875 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2de4c32f-a0ec-472c-9e36-08c732aeb158 req-0c37f70d-042d-4406-b382-e1690ec9cf1d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0468411 Jan 05 15:07:34.833853 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2de4c32f-a0ec-472c-9e36-08c732aeb158 req-af97d454-189e-4109-a150-e868bef6c0ca tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415289 Jan 05 15:07:35.948137 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e27f7d-1207-4667-bb07-4451e64e982a req-b8b0346f-6419-4cc8-b609-a9a1aeeda816 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:35.949604 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-29e27f7d-1207-4667-bb07-4451e64e982a req-b8b0346f-6419-4cc8-b609-a9a1aeeda816 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0482211 Jan 05 15:07:35.994570 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-29e27f7d-1207-4667-bb07-4451e64e982a req-a65995ba-e5ab-4dac-83af-fbb0f64f8d1e tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395052 Jan 05 15:07:37.085132 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Deleting port 32e08202-b8ca-4301-9648-36aacfa35c0a {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:07:37.086018 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:37.107963 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a4b80f-46d6-42dd-a299-834148e03e0e req-ffdce920-e226-4e82-b605-3172ec234d99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:37.109470 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c1a4b80f-46d6-42dd-a299-834148e03e0e req-ffdce920-e226-4e82-b605-3172ec234d99 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 946 time: 0.0487261 Jan 05 15:07:37.156522 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c1a4b80f-46d6-42dd-a299-834148e03e0e req-7b880867-622c-4dfc-bcbe-6de4bc7f12ec tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413578 Jan 05 15:07:37.174860 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] For port 32e08202-b8ca-4301-9648-36aacfa35c0a, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=32e08202-b8ca-4301-9648-36aacfa35c0a,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:07:37.175220 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:37.187899 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling delete_port for 32e08202-b8ca-4301-9648-36aacfa35c0a owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:07:37.364722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:37.390890 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event deleted for resources: {'Port': ['ID=32e08202-b8ca-4301-9648-36aacfa35c0a,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:37.408231 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', '13cea986-c954-4f2a-80f4-f2a459e8a695', 'b4ef5996-5211-497a-bab8-d83c88eea0df'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:07:37.431091 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] No DVR routers for this DVR port 32e08202-b8ca-4301-9648-36aacfa35c0a on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:07:37.433604 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:37.436933 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9e540ec7-3689-4572-b1d7-11398b7923ca req-c2d0ab7b-5955-4e1e-b8fe-4ce7ee1973a2 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "DELETE /v2.0/ports/32e08202-b8ca-4301-9648-36aacfa35c0a HTTP/1.1" status: 204 len: 173 time: 0.4397843 Jan 05 15:07:37.437387 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'name': 'network-vif-deleted', 'tag': '32e08202-b8ca-4301-9648-36aacfa35c0a'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:07:37.440267 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfe08354-9fd1-49ea-ae52-ae5a0384aae6" -d '{"events": [{"server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "name": "network-vif-deleted", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:07:37.476891 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:07:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-683236f5-2c82-4851-8b9b-7003243bdffd x-openstack-request-id: req-683236f5-2c82-4851-8b9b-7003243bdffd {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:07:37.477226 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cb26e42e-5e97-4336-aa5c-20a7f5b439ed", "name": "network-vif-deleted", "tag": "32e08202-b8ca-4301-9648-36aacfa35c0a", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:07:37.477487 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-683236f5-2c82-4851-8b9b-7003243bdffd {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:07:37.477891 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cb26e42e-5e97-4336-aa5c-20a7f5b439ed', 'name': 'network-vif-deleted', 'tag': '32e08202-b8ca-4301-9648-36aacfa35c0a', 'status': 'completed', 'code': 200} Jan 05 15:07:37.906524 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-258acd99-36f5-45ba-8892-67d9a6848ad1 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0446696 Jan 05 15:07:38.025400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-9a39aee5-a25f-4cb0-87b6-695d4fb62349 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:38.027058 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-9a39aee5-a25f-4cb0-87b6-695d4fb62349 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1098 time: 0.0407102 Jan 05 15:07:38.133500 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-874d73fb-3b1a-4310-906c-273ca7c951b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:38.134963 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-874d73fb-3b1a-4310-906c-273ca7c951b1 service neutron] 10.222.0.13 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 909 time: 0.0874810 Jan 05 15:07:38.204245 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-1dfd6542-d1e4-44d4-8df5-5e31105ce008 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 1001 time: 0.0611866 Jan 05 15:07:38.263405 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-f63425e9-c5ac-4375-add9-df1d60dcce28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:38.264868 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-f63425e9-c5ac-4375-add9-df1d60dcce28 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 200 len: 847 time: 0.0505049 Jan 05 15:07:38.271814 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-ad535fd3-559e-4a14-9530-3f31edf3f22d req-2b935185-5063-4513-bcf0-793b07c9070d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=cb26e42e-5e97-4336-aa5c-20a7f5b439ed HTTP/1.1" status: 200 len: 210 time: 0.0299330 Jan 05 15:07:38.319824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-d2a54a76-b956-4def-86ae-72ece176e075 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:38.321331 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-d2a54a76-b956-4def-86ae-72ece176e075 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=e5205e82-a517-4157-848a-78560d0d2806&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0470896 Jan 05 15:07:38.411255 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-34d9abe9-2b6d-4dbf-91b9-7e3300173964 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837436 Jan 05 15:07:38.502638 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-8f824b8c-7cf7-4261-b61d-6d63a3a6d112 req-783ddc63-0f68-463f-b5d6-f2c009cb58f8 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810795 Jan 05 15:07:39.021642 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e08202-b8ca-4301-9648-36aacfa35c0a no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:07:39.044736 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 32e08202-b8ca-4301-9648-36aacfa35c0a {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:07:39.045103 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 32e08202-b8ca-4301-9648-36aacfa35c0a not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:07:41.124069 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8662d93-b854-44f8-8139-5df82e90f496 req-0509a643-4938-40ab-81d7-13edb23f04d5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:41.125565 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f8662d93-b854-44f8-8139-5df82e90f496 req-0509a643-4938-40ab-81d7-13edb23f04d5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 945 time: 0.0529613 Jan 05 15:07:41.182080 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f8662d93-b854-44f8-8139-5df82e90f496 req-981e74a8-7acb-49e0-b0c4-3573f1f77bf5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487459 Jan 05 15:07:42.296561 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf req-659e6444-5ee8-4226-afca-a9c996d6702b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:42.298030 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf req-659e6444-5ee8-4226-afca-a9c996d6702b tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 945 time: 0.0475817 Jan 05 15:07:42.344782 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5f9f2a86-5df7-4492-b3a4-f0ebd69b9edf req-9adf81db-0aa9-4983-9259-37163bd029d8 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412304 Jan 05 15:07:43.458993 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 req-c0acee32-bd13-4e1e-bd74-a7cfc53aef89 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:43.460506 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 req-c0acee32-bd13-4e1e-bd74-a7cfc53aef89 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 945 time: 0.0493574 Jan 05 15:07:43.507930 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ac64f66d-5c84-4926-8a23-b4f8dcd00150 req-47450de2-b7db-4015-bbbc-ebf0de318568 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414195 Jan 05 15:07:44.620697 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e req-60351898-c66b-4e53-9bec-312956937065 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:44.622174 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e req-60351898-c66b-4e53-9bec-312956937065 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 945 time: 0.0480964 Jan 05 15:07:44.667021 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-afe25b7b-b47d-4654-895d-32bf4d5d8a7e req-93f98ca1-4727-485d-93e0-03e0a5b32929 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385926 Jan 05 15:07:45.210888 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d597b300-389a-4700-9479-8982811093e7 req-c2866dfa-2411-4da9-85cb-079fa68819d6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:45.212306 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d597b300-389a-4700-9479-8982811093e7 req-c2866dfa-2411-4da9-85cb-079fa68819d6 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 945 time: 0.0473113 Jan 05 15:07:45.301202 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Deleting port b4ef5996-5211-497a-bab8-d83c88eea0df {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:07:45.301541 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:45.384365 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] For port b4ef5996-5211-497a-bab8-d83c88eea0df, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b4ef5996-5211-497a-bab8-d83c88eea0df,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:07:45.384725 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:45.400717 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling delete_port for b4ef5996-5211-497a-bab8-d83c88eea0df owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:07:45.605076 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:45.632763 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event deleted for resources: {'Port': ['ID=b4ef5996-5211-497a-bab8-d83c88eea0df,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:45.639654 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', '13cea986-c954-4f2a-80f4-f2a459e8a695', 'b4ef5996-5211-497a-bab8-d83c88eea0df'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:07:45.662286 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.662635 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.662972 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.663307 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.663634 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.663964 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.664287 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.664605 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.664929 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.665273 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.665594 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.665909 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.666223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:45.687749 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] No DVR routers for this DVR port b4ef5996-5211-497a-bab8-d83c88eea0df on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:07:45.690610 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:45.693967 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-d597b300-389a-4700-9479-8982811093e7 req-10e2b0d1-78a2-434c-a5fb-e4c4d406caa1 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "DELETE /v2.0/ports/b4ef5996-5211-497a-bab8-d83c88eea0df HTTP/1.1" status: 204 len: 173 time: 0.4762478 Jan 05 15:07:45.703822 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0513327c-8038-49b0-a926-007e79f1c41c', 'name': 'network-vif-deleted', 'tag': 'b4ef5996-5211-497a-bab8-d83c88eea0df'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:07:45.703822 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2381c641-2e0c-4848-b674-8ba520e7cb7e" -d '{"events": [{"server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "name": "network-vif-deleted", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:07:45.736219 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:07:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd14e386-3823-4ce8-8fda-386e4676f7d2 x-openstack-request-id: req-fd14e386-3823-4ce8-8fda-386e4676f7d2 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:07:45.736514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0513327c-8038-49b0-a926-007e79f1c41c", "name": "network-vif-deleted", "tag": "b4ef5996-5211-497a-bab8-d83c88eea0df", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:07:45.736774 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fd14e386-3823-4ce8-8fda-386e4676f7d2 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:07:45.737299 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0513327c-8038-49b0-a926-007e79f1c41c', 'name': 'network-vif-deleted', 'tag': 'b4ef5996-5211-497a-bab8-d83c88eea0df', 'status': 'completed', 'code': 200} Jan 05 15:07:45.766907 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9690901a-fa2b-41c8-a1bb-8782266157e3 req-3137f6a5-53ca-4515-af21-4d53484d1dd5 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 210 time: 0.0266457 Jan 05 15:07:46.875827 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-058294eb-4aaf-47d7-8b00-c520f92cb078 req-a868b285-d76f-496e-acc1-3e60e93d610d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=0513327c-8038-49b0-a926-007e79f1c41c HTTP/1.1" status: 200 len: 210 time: 0.0299065 Jan 05 15:07:48.424567 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 req-dddd287e-5a14-429a-9e14-f7ca8aeeba61 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:48.426128 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 req-dddd287e-5a14-429a-9e14-f7ca8aeeba61 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 945 time: 0.0503254 Jan 05 15:07:48.472720 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4cd3014b-1ab5-4163-b8d7-72e83d2137a8 req-e1210ccb-4f11-45ae-b9ca-b33e9c595a5d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411537 Jan 05 15:07:49.051130 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b4ef5996-5211-497a-bab8-d83c88eea0df no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:07:49.071432 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: b4ef5996-5211-497a-bab8-d83c88eea0df {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:07:49.071789 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b4ef5996-5211-497a-bab8-d83c88eea0df not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:07:49.587676 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 req-b3519748-b59a-45cc-a643-e3200ef9b319 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:49.589311 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 req-b3519748-b59a-45cc-a643-e3200ef9b319 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 945 time: 0.0474555 Jan 05 15:07:49.636446 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-862a020f-6bc0-4124-ae6e-e6d1168a03f7 req-be579458-c54b-456c-aa40-b03e43f9a977 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417457 Jan 05 15:07:49.919365 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-337402ad-61d7-459a-bb76-ec5d8e064df0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:49.920895 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-337402ad-61d7-459a-bb76-ec5d8e064df0 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 945 time: 0.0526717 Jan 05 15:07:50.015604 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Deleting port 13cea986-c954-4f2a-80f4-f2a459e8a695 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:07:50.015604 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:50.099539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] For port 13cea986-c954-4f2a-80f4-f2a459e8a695, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=13cea986-c954-4f2a-80f4-f2a459e8a695,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:07:50.099915 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:50.112952 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling delete_port for 13cea986-c954-4f2a-80f4-f2a459e8a695 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:07:50.338061 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:50.368725 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event deleted for resources: {'Port': ['ID=13cea986-c954-4f2a-80f4-f2a459e8a695,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:50.372430 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', '13cea986-c954-4f2a-80f4-f2a459e8a695'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:07:50.408105 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] No DVR routers for this DVR port 13cea986-c954-4f2a-80f4-f2a459e8a695 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:07:50.410881 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:50.414238 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-883b2f53-2172-4abf-a43d-18d61e5fd056 req-f890a23c-8a1a-4223-aadb-125b9f59ab78 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "DELETE /v2.0/ports/13cea986-c954-4f2a-80f4-f2a459e8a695 HTTP/1.1" status: 204 len: 173 time: 0.4883077 Jan 05 15:07:50.414722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'name': 'network-vif-deleted', 'tag': '13cea986-c954-4f2a-80f4-f2a459e8a695'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:07:50.416924 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebfd46b6-1cd3-4d92-8af8-a6045d038072" -d '{"events": [{"server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "name": "network-vif-deleted", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:07:50.452717 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:07:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef3113b7-7598-4933-b3dc-03af3693930e x-openstack-request-id: req-ef3113b7-7598-4933-b3dc-03af3693930e {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:07:50.453211 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e3239a6e-4795-47bb-8958-e38b87a60e0e", "name": "network-vif-deleted", "tag": "13cea986-c954-4f2a-80f4-f2a459e8a695", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:07:50.453472 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ef3113b7-7598-4933-b3dc-03af3693930e {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:07:50.453869 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e3239a6e-4795-47bb-8958-e38b87a60e0e', 'name': 'network-vif-deleted', 'tag': '13cea986-c954-4f2a-80f4-f2a459e8a695', 'status': 'completed', 'code': 200} Jan 05 15:07:50.729359 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-612c6ac8-0281-4cc3-99ce-51a73f2f83a6 req-05484a23-df95-4c84-bcd4-a0dc262989fa tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=e3239a6e-4795-47bb-8958-e38b87a60e0e HTTP/1.1" status: 200 len: 210 time: 0.0270646 Jan 05 15:07:51.267503 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 50978) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:51.368384 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:51.437319 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:51.509613 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:51.550659 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b5df173b97cf45b1a40c96ee2933e86e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2820733 Jan 05 15:07:51.552580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3a12152-2f05-4030-af90-ee4a49153892,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:51.553373 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 50982) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:51.560580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.560925 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.561323 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.561657 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.561987 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.562310 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.562635 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.562960 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.563283 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.563605 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.563955 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.564288 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.564615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57b3acaf-f389-4ef5-9b28-afba83f27bac admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:07:51.604592 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cd3d4b55-2d2d-41b0-b07f-9830a75d07ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:51.622317 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cd3d4b55-2d2d-41b0-b07f-9830a75d07ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:51.737996 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cd3d4b55-2d2d-41b0-b07f-9830a75d07ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:51.740554 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-cd3d4b55-2d2d-41b0-b07f-9830a75d07ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:51.741708 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-cd3d4b55-2d2d-41b0-b07f-9830a75d07ec admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e3a12152-2f05-4030-af90-ee4a49153892 HTTP/1.1" status: 204 len: 168 time: 0.1874056 Jan 05 15:07:51.749188 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3d4b55-2d2d-41b0-b07f-9830a75d07ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3a12152-2f05-4030-af90-ee4a49153892,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:52.792845 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51010) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:52.885517 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1075471481-network', 'tenant_id': '4ffa8c6fb14941c6ba03ddd2d63c49be'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:07:52.966697 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Made reservation on behalf of 4ffa8c6fb14941c6ba03ddd2d63c49be for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:07:52.968904 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:52.978136 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.047529 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.132676 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.153653 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 107} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:07:53.168869 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c337bf7-06ff-460a-86cf-ed845b54b3a9,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:53.171725 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.172068 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Added segment eecb354a-4972-44ae-a5e5-e5fe7673ae43 of type vlan for network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a Jan 05 15:07:53.215114 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.355267 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.356179 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:53.356787 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.417528 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] Pushing event updated for resources: {'Network': ['ID=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:53.427610 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:07:53.500897 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-248c87aa-665b-4c98-a9a9-2bde170541b3 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7068796 Jan 05 15:07:53.504682 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51018) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:53.514892 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Request body: {'subnet': {'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1075471481-subnet', 'tenant_id': '4ffa8c6fb14941c6ba03ddd2d63c49be', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:07:53.828006 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Made reservation on behalf of 4ffa8c6fb14941c6ba03ddd2d63c49be for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:07:53.830194 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8833947'] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:53.912493 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 req-6e7e484e-3152-4c03-ad4e-bec2f0c12806 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:53.913994 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 req-6e7e484e-3152-4c03-ad4e-bec2f0c12806 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 945 time: 0.3451788 Jan 05 15:07:53.988406 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b6dcd8ae-66c2-464f-a934-2acab77f4fb6 req-3b40eeb3-ab3d-4fcb-8a57-992102b968ab tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631149 Jan 05 15:07:54.172666 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8855778', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8833897'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:54.224603 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d2a43a22-37fb-4c9b-bcbe-1e4cb1759710,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:54.234990 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Checking segment: {'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:07:54.235350 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Network hostable DHCP agents. Network: 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:07:54.315641 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:07:54.398515 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:07:54.402484 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:54.403090 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:54.409251 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef99c165-1d0f-4935-b349-ffb06f8b5448 None None] Network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:07:54.500244 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-bdf29afe-e4fa-4327-bcda-2ab4401b11b2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.9950395 Jan 05 15:07:54.502503 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b41975b-254e-4fd2-afc8-b42906ab1692 None None] Network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:07:55.078583 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 13cea986-c954-4f2a-80f4-f2a459e8a695 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:07:55.103205 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 13cea986-c954-4f2a-80f4-f2a459e8a695 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:07:55.103551 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 13cea986-c954-4f2a-80f4-f2a459e8a695 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:07:55.107493 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0227a69c-6172-496c-8afd-38919fa5dd55 req-d9b4f4e8-6349-4b44-af0c-385eb6b12a34 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:55.108964 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0227a69c-6172-496c-8afd-38919fa5dd55 req-d9b4f4e8-6349-4b44-af0c-385eb6b12a34 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 945 time: 0.0497262 Jan 05 15:07:55.156963 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0227a69c-6172-496c-8afd-38919fa5dd55 req-f6f6b233-7005-4a12-9b71-95eabedec14f tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/security-groups?id=c978cfc7-bd69-439c-b1cf-84351cad64e7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419543 Jan 05 15:07:55.225539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-b8b58b39-7f04-47bb-81f6-d567428665de tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:55.227266 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-b8b58b39-7f04-47bb-81f6-d567428665de tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 945 time: 0.0634410 Jan 05 15:07:55.323000 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Deleting port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:07:55.323340 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:55.413608 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] For port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,segment=NetworkSegment(88c3102d-b3ce-4ec1-8d0d-61de3749ce55),segment_id=88c3102d-b3ce-4ec1-8d0d-61de3749ce55)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:07:55.413969 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:55.426714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Calling delete_port for 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:07:55.638876 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:55.665754 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Pushing event deleted for resources: {'Port': ['ID=906a8d4e-ebf8-4e84-9c63-6111c3e36d6b,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:55.673191 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['906a8d4e-ebf8-4e84-9c63-6111c3e36d6b'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:07:55.706723 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] No DVR routers for this DVR port 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:07:55.708935 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:55.712209 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9e4a8c43-53a1-40b8-9fb3-b11533413f00 req-72f25a4b-7898-4879-8840-75e98f411e29 tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.13 "DELETE /v2.0/ports/906a8d4e-ebf8-4e84-9c63-6111c3e36d6b HTTP/1.1" status: 204 len: 173 time: 0.4801028 Jan 05 15:07:55.712642 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'name': 'network-vif-deleted', 'tag': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:07:55.714949 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02b51eb5-120b-44bb-8bd1-a478f82fb493" -d '{"events": [{"server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "name": "network-vif-deleted", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:07:55.750420 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:07:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 x-openstack-request-id: req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:07:55.750731 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c16547ce-867c-46c9-9117-9a3ff7f2b0e9", "name": "network-vif-deleted", "tag": "906a8d4e-ebf8-4e84-9c63-6111c3e36d6b", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:07:55.750988 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fc2e64ba-6834-4a20-ab5a-8e322a6ae061 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:07:55.751385 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c16547ce-867c-46c9-9117-9a3ff7f2b0e9', 'name': 'network-vif-deleted', 'tag': '906a8d4e-ebf8-4e84-9c63-6111c3e36d6b', 'status': 'completed', 'code': 200} Jan 05 15:07:56.259869 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6678ee1e-91ab-48e4-8a68-977ba34b0430 req-f6884275-0d55-485c-be1c-4cd14989410d tempest-AttachVolumeNegativeTest-2093322314 tempest-AttachVolumeNegativeTest-2093322314-project] 10.222.0.30 "GET /v2.0/ports?device_id=c16547ce-867c-46c9-9117-9a3ff7f2b0e9 HTTP/1.1" status: 200 len: 210 time: 0.0252657 Jan 05 15:07:56.518801 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-f9c1b56b-fae8-4a34-bbda-2408781b9e3d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:56.520288 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-f9c1b56b-fae8-4a34-bbda-2408781b9e3d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/networks?id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a HTTP/1.1" status: 200 len: 814 time: 0.1098747 Jan 05 15:07:56.535359 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-c8268da6-0ce0-481b-9b4a-d6a5b890738c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/quotas/4ffa8c6fb14941c6ba03ddd2d63c49be HTTP/1.1" status: 200 len: 375 time: 0.0095961 Jan 05 15:07:56.566410 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-5849e76c-38ac-4f51-be9b-e4b40f54827f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0258846 Jan 05 15:07:56.654377 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-1ee0f6a7-e51b-441e-b8a5-c1de6331f52b service neutron] 10.222.0.30 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814905 Jan 05 15:07:56.744648 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-a1b6deb2-3b45-4956-af00-51c3ef9b5761 service neutron] 10.222.0.30 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836663 Jan 05 15:07:56.957425 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-14403e2a-eca2-4057-b990-572f15962e1d req-c77476b3-90a3-4c53-995a-cc8d8beb357e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 210 time: 0.0257187 Jan 05 15:07:57.315227 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51062) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:57.359509 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_v2 [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] Deleting subnet 9561926f-aba3-4028-bd06-409215177cc6 {{(pid=114654) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:07:57.363420 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.396941 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8770652'] for subnet, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.438471 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.567086 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8855717', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8833888'] for subnet, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.592791 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9561926f-aba3-4028-bd06-409215177cc6,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:57.598963 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.602531 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-551f4e6e-f96e-46f4-9c1e-0d598ebcbac5 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/9561926f-aba3-4028-bd06-409215177cc6 HTTP/1.1" status: 204 len: 168 time: 0.2862425 Jan 05 15:07:57.605263 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51066) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:57.674015 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.748251 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.768591 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['15d9f439-989e-49bd-a540-259f7f374d29']}} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:07:57.777500 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88c3102d-b3ce-4ec1-8d0d-61de3749ce55') {'for_net_delete': True} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:07:57.777795 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88c3102d-b3ce-4ec1-8d0d-61de3749ce55') {} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:07:57.790484 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4701328'] for segment, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.803035 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.808747 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Releasing vlan 111 on physical network physnet1 to pool {{(pid=114655) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:07:57.810171 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4698958'] for segment, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: Traceback (most recent call last): Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: timer() Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: cb(*args, **kw) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: return func(*args, **kwargs) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: self._notify() Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: self.callback(batched_events) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: event.method(event) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: return f(self, *a, **k) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: return self._get(url).json() Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: return self.request(url, 'GET', **kwargs) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:07:57.819793 dv-cinder-master-3-iscsi neutron-server[114655]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:07:57.926733 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.936561 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:57.936561 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] 10.222.0.30 "DELETE /v2.0/networks/15d9f439-989e-49bd-a540-259f7f374d29 HTTP/1.1" status: 204 len: 168 time: 0.3296571 Jan 05 15:07:57.948083 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed92e65-0ab7-49b3-82c0-3b85e4eafa98 admin admin] Pushing event deleted for resources: {'Network': ['ID=15d9f439-989e-49bd-a540-259f7f374d29,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:58.051757 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-594610eb-d4ad-4543-b113-78a44f0f0653 req-afea325e-b4b8-45d3-8319-a52cdd474f58 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 210 time: 0.0247617 Jan 05 15:07:58.212563 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5710d2b6-c0d4-4120-b9e8-f3dd2871222a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:58.365697 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51072) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:58.409540 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0b005c87-f894-48aa-98d4-3180fb6610bb admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=97821d0c0c79446abba323f103c8244a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0426817 Jan 05 15:07:58.411887 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51074) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:07:58.458567 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-faaf81ca-c68b-4ccb-8af9-7f104fd1d6cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:58.484361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-faaf81ca-c68b-4ccb-8af9-7f104fd1d6cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:58.617781 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-faaf81ca-c68b-4ccb-8af9-7f104fd1d6cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:58.620367 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-faaf81ca-c68b-4ccb-8af9-7f104fd1d6cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:58.621534 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-faaf81ca-c68b-4ccb-8af9-7f104fd1d6cb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c978cfc7-bd69-439c-b1cf-84351cad64e7 HTTP/1.1" status: 204 len: 168 time: 0.2087476 Jan 05 15:07:58.628903 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faaf81ca-c68b-4ccb-8af9-7f104fd1d6cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c978cfc7-bd69-439c-b1cf-84351cad64e7,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:07:59.092855 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:07:59.114416 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:07:59.114768 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 906a8d4e-ebf8-4e84-9c63-6111c3e36d6b not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:07:59.154225 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-62123179-201f-4e57-9d36-43f9d19b2144 req-b36b1c65-119e-4e99-849a-748befc6a664 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 210 time: 0.0270391 Jan 05 15:07:59.319620 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-fea2b458-148b-4a02-9052-7aac4cf7bf30 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:07:59.321317 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-fea2b458-148b-4a02-9052-7aac4cf7bf30 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "GET /v2.0/networks?id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a HTTP/1.1" status: 200 len: 814 time: 0.1030571 Jan 05 15:07:59.338347 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Request body: {'port': {'device_id': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a', 'admin_state_up': True, 'tenant_id': '4ffa8c6fb14941c6ba03ddd2d63c49be'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:07:59.544029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Made reservation on behalf of 4ffa8c6fb14941c6ba03ddd2d63c49be for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:07:59.547798 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:59.678173 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Allocated IP 172.20.0.9 (4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a/d2a43a22-37fb-4c9b-bcbe-1e4cb1759710/e0bb8034-8d8b-416c-acf5-c75f60e6f363) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:07:59.821600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:59.927296 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:07:59.970516 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:07:59.974103 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:07:59.978149 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:08:00.007032 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Pushing event updated for resources: {'Port': ['ID=e0bb8034-8d8b-416c-acf5-c75f60e6f363,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:00.032227 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:00.032847 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.126932 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-d6977e0e-7281-44bf-b11a-92e3b4928ae6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7923839 Jan 05 15:08:00.142920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Request body: {'port': {'device_id': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:00.195133 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.319145 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76c0406-3365-47de-b6f7-db13ccb612e7 req-f5a95fec-8b7a-4237-8873-97f2c15787c5 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:00.321748 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d76c0406-3365-47de-b6f7-db13ccb612e7 req-f5a95fec-8b7a-4237-8873-97f2c15787c5 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 931 time: 0.0528331 Jan 05 15:08:00.374817 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d76c0406-3365-47de-b6f7-db13ccb612e7 req-eebaa33e-0304-49c6-9783-d3a5da90e2e9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465229 Jan 05 15:08:00.422008 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-93cc1be0-c097-4386-8069-636a1bf3504f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.481995 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e0bb8034-8d8b-416c-acf5-c75f60e6f363 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:08:00.489535 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.501910 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Transition to ACTIVE for port object e0bb8034-8d8b-416c-acf5-c75f60e6f363 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:08:00.572159 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.640847 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Pushing event updated for resources: {'Port': ['ID=e0bb8034-8d8b-416c-acf5-c75f60e6f363,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:00.692538 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Attempting to bind port e0bb8034-8d8b-416c-acf5-c75f60e6f363 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:08:00.693255 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Attempting to bind port e0bb8034-8d8b-416c-acf5-c75f60e6f363 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:08:00.693255 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Attempting to bind port e0bb8034-8d8b-416c-acf5-c75f60e6f363 on network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:08:00.697463 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Port e0bb8034-8d8b-416c-acf5-c75f60e6f363 on network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:08:00.697791 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Attempting to bind port e0bb8034-8d8b-416c-acf5-c75f60e6f363 on network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:08:00.702873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 7, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:08:00.703877 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Checking segment: {'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:00.703877 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Bound using segment: {'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:08:00.704242 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Bound port: e0bb8034-8d8b-416c-acf5-c75f60e6f363, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:08:00.704491 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.766037 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] For port e0bb8034-8d8b-416c-acf5-c75f60e6f363, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:08:00.769569 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] For port e0bb8034-8d8b-416c-acf5-c75f60e6f363, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e0bb8034-8d8b-416c-acf5-c75f60e6f363,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:08:00.846823 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.871811 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51120) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:00.882496 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:00.883204 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:00.884681 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] 10.222.0.13 "PUT /v2.0/ports/e0bb8034-8d8b-416c-acf5-c75f60e6f363 HTTP/1.1" status: 200 len: 1093 time: 0.7459259 Jan 05 15:08:00.885315 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'tag': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:08:00.888093 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-334fc096-118b-4942-be72-8aa26ed89fd3" -d '{"events": [{"name": "network-changed", "server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:08:00.913587 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36ec84fc-6f19-4ecf-aedd-251e4238360d service neutron] Pushing event updated for resources: {'Port': ['ID=e0bb8034-8d8b-416c-acf5-c75f60e6f363,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:00.947686 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:08:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-735b07ac-389b-47e5-a2f6-06e3f3f41352 x-openstack-request-id: req-735b07ac-389b-47e5-a2f6-06e3f3f41352 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:08:00.948416 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:08:00.948782 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-735b07ac-389b-47e5-a2f6-06e3f3f41352 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:08:00.949329 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'tag': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363', 'status': 'completed', 'code': 200} Jan 05 15:08:01.029656 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-0064af02-05e4-4794-9037-e138581c42f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:01.031151 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-0064af02-05e4-4794-9037-e138581c42f8 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 1096 time: 0.0413167 Jan 05 15:08:01.042417 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Deleting port 243d8473-2700-4d07-9b49-de450e7a88cf {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:01.042762 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:01.118709 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:01.119039 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:01.134648 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling delete_port for 243d8473-2700-4d07-9b49-de450e7a88cf owned by network:floatingip {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:01.143647 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-8cc6a9fe-4001-45f8-ae2d-08414d743720 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:01.145347 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-8cc6a9fe-4001-45f8-ae2d-08414d743720 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1001735 Jan 05 15:08:01.240139 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-a144180c-ce35-4ef9-8499-1430c61aac52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:01.241629 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-334fc096-118b-4942-be72-8aa26ed89fd3 req-a144180c-ce35-4ef9-8499-1430c61aac52 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0906250 Jan 05 15:08:01.341669 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-0f06514a-d16e-420f-a313-9cec5122b348 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:01.343149 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-0f06514a-d16e-420f-a313-9cec5122b348 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 1096 time: 0.0448802 Jan 05 15:08:01.387180 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:01.389406 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-0108a551-2f7d-48cb-99ba-23c08ee49db3 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e0bb8034-8d8b-416c-acf5-c75f60e6f363 HTTP/1.1" status: 200 len: 217 time: 0.0341399 Jan 05 15:08:01.414954 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event deleted for resources: {'Port': ['ID=243d8473-2700-4d07-9b49-de450e7a88cf,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:01.444652 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-f973f47e-0cbf-4ce9-a718-456edd5f6c39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:01.446169 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-f973f47e-0cbf-4ce9-a718-456edd5f6c39 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=d2a43a22-37fb-4c9b-bcbe-1e4cb1759710 HTTP/1.1" status: 200 len: 854 time: 0.0512853 Jan 05 15:08:01.477301 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-441e95a5-333b-4983-a6bd-f024a3533d7b service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0256610 Jan 05 15:08:01.511856 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for floatingip, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:01.512261 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Floating IP 9cdb696f-0e62-4bcf-ab96-e4f6f26366b4 disassociated (deleted). External IP: 172.37.2.221, port: b7c14da5-847f-4d0d-9e0e-5c9ad34c581c. Jan 05 15:08:01.571072 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da5d266-f9a5-4804-9b69-6ba81ecde33a req-54d8a326-be98-4771-b92a-83846cb8008a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:01.572668 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0da5d266-f9a5-4804-9b69-6ba81ecde33a req-54d8a326-be98-4771-b92a-83846cb8008a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 943 time: 0.1061850 Jan 05 15:08:01.586253 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-5a9eb111-6d9e-4f9f-b427-ad334ca7febb service neutron] 10.222.0.13 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1032131 Jan 05 15:08:01.673473 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0da5d266-f9a5-4804-9b69-6ba81ecde33a req-d8904cf9-dcf1-4ad0-a0ab-e183ec69c0b7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0849891 Jan 05 15:08:01.688318 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ca7b8aa4-7a3b-44da-aedd-cc040710f07a req-e101216c-382c-4fb5-b456-ee2de122ab4f service neutron] 10.222.0.13 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950603 Jan 05 15:08:01.776928 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Router b38ee346-0c33-4eb4-8342-134f3f715196 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:08:01.835241 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:01.883297 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:08:01.888129 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:01.893919 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] Sync routers for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:08:01.903685 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:01.904298 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:01.915955 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-30b29835-9ca7-4c4b-9eac-03f965274246 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "DELETE /v2.0/floatingips/9cdb696f-0e62-4bcf-ab96-e4f6f26366b4 HTTP/1.1" status: 204 len: 168 time: 1.0426075 Jan 05 15:08:01.917001 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:08:01.919286 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dab96606-cbc1-40fa-9c57-5093a7b7b561" -d '{"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:08:01.959531 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:08:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a7fb0b6-0122-488a-ba10-00a90d53a99f x-openstack-request-id: req-7a7fb0b6-0122-488a-ba10-00a90d53a99f {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:08:01.959821 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:08:01.960073 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7a7fb0b6-0122-488a-ba10-00a90d53a99f {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:08:01.960468 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'status': 'completed', 'code': 200} Jan 05 15:08:02.028722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:02.048449 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-6ba8958c-7303-42be-adaf-854dacaf4592 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:02.050022 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-6ba8958c-7303-42be-adaf-854dacaf4592 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=c3797435200949c8a45be6c5b0525dc0&device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 1098 time: 0.0451670 Jan 05 15:08:02.142134 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-b09c7497-7242-4a66-88e1-fe17142eb82b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:02.144010 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-b09c7497-7242-4a66-88e1-fe17142eb82b service neutron] 10.222.0.13 "GET /v2.0/networks?id=e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 200 len: 909 time: 0.0871873 Jan 05 15:08:02.189170 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-56087c3a-5bc5-4306-b699-018bce54204d service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 200 len: 217 time: 0.0388572 Jan 05 15:08:02.237880 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:06Z', 'revision_number': 5, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:02.239270 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-93920c63-2234-4fd0-9d13-0a245878925e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:02.240770 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-93920c63-2234-4fd0-9d13-0a245878925e service neutron] 10.222.0.13 "GET /v2.0/subnets?id=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 200 len: 847 time: 0.0452800 Jan 05 15:08:02.268406 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] Checking router: b38ee346-0c33-4eb4-8342-134f3f715196 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:08:02.276544 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:02.277174 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:02.322223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-fd8a6575-4790-46ba-b631-f55ec74bb1b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:02.324686 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-fd8a6575-4790-46ba-b631-f55ec74bb1b0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=e5205e82-a517-4157-848a-78560d0d2806&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0726440 Jan 05 15:08:02.394370 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:02.422860 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe896b5-e1c3-4ceb-8400-9b388232791e req-b8d228bd-ffe5-4b29-8b75-78c18a852570 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:02.426644 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bbe896b5-e1c3-4ceb-8400-9b388232791e req-b8d228bd-ffe5-4b29-8b75-78c18a852570 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0539827 Jan 05 15:08:02.480277 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-f17ba626-3d99-48c5-ad91-c05163d98e6d service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1084867 Jan 05 15:08:02.487960 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bbe896b5-e1c3-4ceb-8400-9b388232791e req-c44b6805-d079-466b-b157-b7d5b66493da tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0574098 Jan 05 15:08:02.590359 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dab96606-cbc1-40fa-9c57-5093a7b7b561 req-6a85c2dc-4da6-4e99-a504-f9db5835bd60 service neutron] 10.222.0.13 "GET /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1022317 Jan 05 15:08:02.753585 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:06Z', 'revision_number': 5, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:02.780501 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:02.781372 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f84cc76-8c1a-41d9-9d47-2f8886c6667d None None] The sync data for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi is: [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:03:01Z', 'revision_number': 4, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '81e8155b-5d11-486f-885b-dcbde5c4defc', 'name': '', 'network_id': 'e5205e82-a517-4157-848a-78560d0d2806', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'mac_address': 'fa:16:3e:bd:09:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_interface', 'standard_attr_id': 399, 'fixed_ips': [{'subnet_id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:00Z', 'updated_at': '2022-01-05T15:03:06Z', 'revision_number': 5, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'subnets': [{'id': 'c3f10689-3a61-4de7-8ebe-99aa4c5a6a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:08:02.789421 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994165b7-662d-460e-9205-94c924bd5da9 req-54214ea2-9aec-4e4c-9b17-1c2d26b1e289 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:02.790949 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-994165b7-662d-460e-9205-94c924bd5da9 req-54214ea2-9aec-4e4c-9b17-1c2d26b1e289 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 943 time: 0.0495479 Jan 05 15:08:02.840165 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-994165b7-662d-460e-9205-94c924bd5da9 req-5aa5df1b-5059-4d8c-9b04-cb3e44d50431 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432987 Jan 05 15:08:02.993675 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27be661e-3908-49d3-90e5-13614a1c3200 None None] New status for floating IP 9cdb696f-0e62-4bcf-ab96-e4f6f26366b4: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:08:03.611539 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de77d95f-f07e-478d-8d86-d1a37f5e6358 req-ec97d48f-f57a-4f13-bf3c-aaa77d002531 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:03.613006 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-de77d95f-f07e-478d-8d86-d1a37f5e6358 req-ec97d48f-f57a-4f13-bf3c-aaa77d002531 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0513420 Jan 05 15:08:03.627132 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:03.662603 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-de77d95f-f07e-478d-8d86-d1a37f5e6358 req-f89260fd-38da-4c37-9021-bb2854a48e43 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/security-groups?id=773a9e22-40c2-499c-8bf9-0e8887977b03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431142 Jan 05 15:08:03.957703 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 req-8724dc02-c36f-4b3f-9e3b-32a68d0d612d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:03.959695 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 req-8724dc02-c36f-4b3f-9e3b-32a68d0d612d tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 943 time: 0.0538516 Jan 05 15:08:04.006816 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6f50cebb-06eb-4ad3-a7e6-c94a1145aab0 req-08e2a7ce-a7e4-4e46-a824-8c68a80380ff tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413258 Jan 05 15:08:04.064202 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452bd289-166d-4b97-b015-7993fd7001a6 req-ef52d33f-6900-4bef-b52d-53e9ef9f75bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:04.066233 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-452bd289-166d-4b97-b015-7993fd7001a6 req-ef52d33f-6900-4bef-b52d-53e9ef9f75bc tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.13 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 945 time: 0.0514486 Jan 05 15:08:04.158004 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Deleting port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:04.158376 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:04.245119 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] For port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:04.245539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:04.258622 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Calling delete_port for b7c14da5-847f-4d0d-9e0e-5c9ad34c581c owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:04.421614 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:04.469441 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:04.504460 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event deleted for resources: {'Port': ['ID=b7c14da5-847f-4d0d-9e0e-5c9ad34c581c,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:04.541778 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] No DVR routers for this DVR port b7c14da5-847f-4d0d-9e0e-5c9ad34c581c on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:08:04.544102 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:04.547414 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-452bd289-166d-4b97-b015-7993fd7001a6 req-6e2ee0ac-ccf9-4e5a-be02-57f2f973c385 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.13 "DELETE /v2.0/ports/b7c14da5-847f-4d0d-9e0e-5c9ad34c581c HTTP/1.1" status: 204 len: 173 time: 0.4757330 Jan 05 15:08:04.547846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-deleted', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:08:04.550075 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c62664dd-c00f-4e94-840a-0be707f16ae0" -d '{"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-deleted", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:08:04.584270 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:08:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 x-openstack-request-id: req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:08:04.584565 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61994ccf-e8cd-41a1-aad1-c56ee0edd0af", "name": "network-vif-deleted", "tag": "b7c14da5-847f-4d0d-9e0e-5c9ad34c581c", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:08:04.584827 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-db3dcb11-8f2d-4a11-847d-3c35707c6a09 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:08:04.585261 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61994ccf-e8cd-41a1-aad1-c56ee0edd0af', 'name': 'network-vif-deleted', 'tag': 'b7c14da5-847f-4d0d-9e0e-5c9ad34c581c', 'status': 'completed', 'code': 200} Jan 05 15:08:04.756484 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c09e79e0-0e10-478f-b0f9-23662848505c req-852b1f40-c80d-44f1-853e-5adad1c34fcf tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 210 time: 0.0292754 Jan 05 15:08:05.046848 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:08:05.122983 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f req-abbfb340-ddeb-492d-8505-2fd6a412cbb0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:05.124487 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f req-abbfb340-ddeb-492d-8505-2fd6a412cbb0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 943 time: 0.0485363 Jan 05 15:08:05.130118 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device e0bb8034-8d8b-416c-acf5-c75f60e6f363 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:08:05.175810 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-5b8bb793-b4d3-4452-aef6-0c3ad358ce6f req-07a72754-c3fa-4cba-8979-4bc63f7f4eb2 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442102 Jan 05 15:08:05.230032 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port e0bb8034-8d8b-416c-acf5-c75f60e6f363, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e0bb8034-8d8b-416c-acf5-c75f60e6f363,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:05.240795 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363', 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a', 'port_id': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363', 'mac_address': 'fa:16:3e:13:e7:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd2a43a22-37fb-4c9b-bcbe-1e4cb1759710', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:08:05.280722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:05.293171 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e0bb8034-8d8b-416c-acf5-c75f60e6f363 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:08:05.311363 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port e0bb8034-8d8b-416c-acf5-c75f60e6f363, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e0bb8034-8d8b-416c-acf5-c75f60e6f363,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:05.440726 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:05.490362 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=e0bb8034-8d8b-416c-acf5-c75f60e6f363,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:05.497917 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.498331 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.498722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.499157 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.499504 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.499842 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.500179 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.500538 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.500846 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.501210 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.505019 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.505019 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.505019 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:05.740709 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['e0bb8034-8d8b-416c-acf5-c75f60e6f363'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:08:05.863150 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-5b33dbed-291e-4be4-9872-fa48f640469d req-da30b0a1-995b-496a-a283-f5cabdcd9f7f tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "GET /v2.0/ports?device_id=61994ccf-e8cd-41a1-aad1-c56ee0edd0af HTTP/1.1" status: 200 len: 210 time: 0.0280318 Jan 05 15:08:06.294211 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d7c319-4068-4602-bac3-6c80a5c650eb req-4944b834-69ee-4c3f-9245-2ac3d2018080 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:06.295779 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-09d7c319-4068-4602-bac3-6c80a5c650eb req-4944b834-69ee-4c3f-9245-2ac3d2018080 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 944 time: 0.0516272 Jan 05 15:08:06.341847 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-09d7c319-4068-4602-bac3-6c80a5c650eb req-b321ff24-996e-4625-86e7-ce8aafb7b32a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399835 Jan 05 15:08:06.440371 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51208) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:06.543870 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a8d18a67-b487-4232-b7ab-ec36914b2df7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:06.613986 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a8d18a67-b487-4232-b7ab-ec36914b2df7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:06.669044 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a8d18a67-b487-4232-b7ab-ec36914b2df7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:06.705868 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a8d18a67-b487-4232-b7ab-ec36914b2df7 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=47395d81001b472092cd9c5bb2b22cae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2644317 Jan 05 15:08:06.707306 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d18a67-b487-4232-b7ab-ec36914b2df7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87038147-02fd-49b3-98f4-68a21af8d4dd,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:06.709173 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51212) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:06.755512 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c73bed40-cbec-46de-a71f-38681d22a563 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:06.776199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c73bed40-cbec-46de-a71f-38681d22a563 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:06.880673 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c73bed40-cbec-46de-a71f-38681d22a563 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:06.883325 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c73bed40-cbec-46de-a71f-38681d22a563 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:06.884463 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c73bed40-cbec-46de-a71f-38681d22a563 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/87038147-02fd-49b3-98f4-68a21af8d4dd HTTP/1.1" status: 204 len: 168 time: 0.1742909 Jan 05 15:08:06.892494 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73bed40-cbec-46de-a71f-38681d22a563 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87038147-02fd-49b3-98f4-68a21af8d4dd,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:06.924497 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51218) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:06.980748 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40aab61a-9271-4e6d-a926-95d6afa64c89 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.005336 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40aab61a-9271-4e6d-a926-95d6afa64c89 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.140663 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device e0bb8034-8d8b-416c-acf5-c75f60e6f363 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:08:07.210078 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40aab61a-9271-4e6d-a926-95d6afa64c89 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.212761 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-40aab61a-9271-4e6d-a926-95d6afa64c89 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.214055 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-40aab61a-9271-4e6d-a926-95d6afa64c89 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] 10.222.0.30 "DELETE /v2.0/security-groups/773a9e22-40c2-499c-8bf9-0e8887977b03 HTTP/1.1" status: 204 len: 168 time: 0.2885053 Jan 05 15:08:07.224246 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40aab61a-9271-4e6d-a926-95d6afa64c89 tempest-TestShelveInstance-186642234 tempest-TestShelveInstance-186642234-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=773a9e22-40c2-499c-8bf9-0e8887977b03,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:07.284216 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port e0bb8034-8d8b-416c-acf5-c75f60e6f363 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:08:07.288358 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port e0bb8034-8d8b-416c-acf5-c75f60e6f363 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:07.288720 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.336608 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51224) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:07.370529 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.395060 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:08:07.397518 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b42b0ee3-bae2-45c3-a0a7-3cc3f27f605d" -d '{"events": [{"server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "name": "network-vif-plugged", "status": "completed", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:08:07.411587 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port e0bb8034-8d8b-416c-acf5-c75f60e6f363, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e0bb8034-8d8b-416c-acf5-c75f60e6f363,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:07.456712 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:08:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd8f3017-97d5-490a-94cb-5d8f52304d55 x-openstack-request-id: req-cd8f3017-97d5-490a-94cb-5d8f52304d55 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:08:07.457000 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "name": "network-vif-plugged", "status": "completed", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:08:07.457282 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cd8f3017-97d5-490a-94cb-5d8f52304d55 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:08:07.457669 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363', 'code': 200} Jan 05 15:08:07.495777 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.496571 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b7c14da5-847f-4d0d-9e0e-5c9ad34c581c no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:08:07.510069 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d08a36-2abb-4677-ac06-5c1712873e9b req-37ed4260-655b-4fe9-98a2-7769c0525e22 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:07.512291 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-52d08a36-2abb-4677-ac06-5c1712873e9b req-37ed4260-655b-4fe9-98a2-7769c0525e22 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 944 time: 0.0992193 Jan 05 15:08:07.544594 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: b7c14da5-847f-4d0d-9e0e-5c9ad34c581c {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:08:07.544938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device b7c14da5-847f-4d0d-9e0e-5c9ad34c581c not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:08:07.570835 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=e0bb8034-8d8b-416c-acf5-c75f60e6f363,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:07.600847 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51232) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:07.615737 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-943f2088-2720-4be4-89b2-c953fafe92e6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.640720 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-52d08a36-2abb-4677-ac06-5c1712873e9b req-21e7b0d3-d02c-4084-a133-a7cf05ab911c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1196306 Jan 05 15:08:07.696026 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-943f2088-2720-4be4-89b2-c953fafe92e6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.738539 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-943f2088-2720-4be4-89b2-c953fafe92e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.774292 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943f2088-2720-4be4-89b2-c953fafe92e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bd258d8-9e15-4ec6-a2e9-caf346ebf9d3,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:07.781855 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-943f2088-2720-4be4-89b2-c953fafe92e6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=18c879a000f141f98d8726c2ef7b47da&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1768885 Jan 05 15:08:07.782777 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51234) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:07.794947 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279a6b90-228a-4dc7-bfd7-12d1da41e0ed req-a874de36-7ad5-43bd-9b39-7ea2dc04ad01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:07.796429 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-279a6b90-228a-4dc7-bfd7-12d1da41e0ed req-a874de36-7ad5-43bd-9b39-7ea2dc04ad01 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 1098 time: 0.0750613 Jan 05 15:08:07.828671 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a4b060c8-b4ad-4dae-bf06-b854889e6ac0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.850460 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a4b060c8-b4ad-4dae-bf06-b854889e6ac0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.859706 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-279a6b90-228a-4dc7-bfd7-12d1da41e0ed req-cf14f411-eb42-4d26-b1ea-514688564436 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571921 Jan 05 15:08:07.908031 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.943754 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a4b060c8-b4ad-4dae-bf06-b854889e6ac0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.946408 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-a4b060c8-b4ad-4dae-bf06-b854889e6ac0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:07.949514 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-a4b060c8-b4ad-4dae-bf06-b854889e6ac0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4bd258d8-9e15-4ec6-a2e9-caf346ebf9d3 HTTP/1.1" status: 204 len: 168 time: 0.1665082 Jan 05 15:08:07.957986 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b060c8-b4ad-4dae-bf06-b854889e6ac0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bd258d8-9e15-4ec6-a2e9-caf346ebf9d3,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:08.162492 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Deleting port 81e8155b-5d11-486f-885b-dcbde5c4defc {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:08.162747 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:08.238571 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] For port 81e8155b-5d11-486f-885b-dcbde5c4defc, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=81e8155b-5d11-486f-885b-dcbde5c4defc,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:08.238931 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:08.255046 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Calling delete_port for 81e8155b-5d11-486f-885b-dcbde5c4defc owned by network:router_interface {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:08.541645 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:08.577393 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Pushing event deleted for resources: {'Port': ['ID=81e8155b-5d11-486f-885b-dcbde5c4defc,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:08.701410 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51242) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:08.726334 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8e04a539-31cb-4365-8e45-79fe31b69746 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:08.821018 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3634adb3-f412-4d90-9879-298cf7d44c31 req-6af21acd-97a2-4084-a963-b590989b9b4b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:08.822765 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3634adb3-f412-4d90-9879-298cf7d44c31 req-6af21acd-97a2-4084-a963-b590989b9b4b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 945 time: 0.0798426 Jan 05 15:08:08.896128 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8e04a539-31cb-4365-8e45-79fe31b69746 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:08.901152 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3634adb3-f412-4d90-9879-298cf7d44c31 req-8625fa5a-b2dd-4428-aa62-80f977bfa876 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655026 Jan 05 15:08:08.953336 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8e04a539-31cb-4365-8e45-79fe31b69746 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:08.991218 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e04a539-31cb-4365-8e45-79fe31b69746 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=065e347c-b8bf-481b-b54d-5819b22f76e6,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:08.995570 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-8e04a539-31cb-4365-8e45-79fe31b69746 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b2097a653534454a941dde0b526c2407&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2930245 Jan 05 15:08:08.999331 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51244) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:09.022771 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.049764 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-937561b1-5e69-44d0-b825-7d3c7b4e9478 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.071265 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-937561b1-5e69-44d0-b825-7d3c7b4e9478 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.189542 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-937561b1-5e69-44d0-b825-7d3c7b4e9478 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.192648 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-937561b1-5e69-44d0-b825-7d3c7b4e9478 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.193861 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-937561b1-5e69-44d0-b825-7d3c7b4e9478 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/065e347c-b8bf-481b-b54d-5819b22f76e6 HTTP/1.1" status: 204 len: 168 time: 0.1939836 Jan 05 15:08:09.203863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937561b1-5e69-44d0-b825-7d3c7b4e9478 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=065e347c-b8bf-481b-b54d-5819b22f76e6,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:09.237848 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Router b38ee346-0c33-4eb4-8342-134f3f715196 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:08:09.350481 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:08:09.358474 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51248) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:09.358634 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-ab15005b-be1f-4af1-9481-247df1f0f1f2 admin admin] 10.222.0.30 "PUT /v2.0/routers/b38ee346-0c33-4eb4-8342-134f3f715196/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0205984 Jan 05 15:08:09.363500 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] Sync routers for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:08:09.374686 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:09.375313 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:09.461227 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks [] for router, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.480486 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:09.566407 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.668070 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20'}], 'enable_snat': True}, 'gw_port_id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:08:08Z', 'revision_number': 5, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port': {'id': 'f52cee16-e7b4-4acc-9ce6-5dad24163904', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:35:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'device_owner': 'network:router_gateway', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:02:57Z', 'updated_at': '2022-01-05T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:09.684279 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Deleting port f52cee16-e7b4-4acc-9ce6-5dad24163904 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:09.684628 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.698181 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] Checking router: b38ee346-0c33-4eb4-8342-134f3f715196 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:08:09.706764 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] Routers {'b38ee346-0c33-4eb4-8342-134f3f715196'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:09.707376 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b38ee346-0c33-4eb4-8342-134f3f715196'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:09.775216 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] For port f52cee16-e7b4-4acc-9ce6-5dad24163904, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f52cee16-e7b4-4acc-9ce6-5dad24163904,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:09.775840 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:09.792281 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Calling delete_port for f52cee16-e7b4-4acc-9ce6-5dad24163904 owned by network:router_gateway {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:09.795192 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] Set router b38ee346-0c33-4eb4-8342-134f3f715196 gateway port host: None {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:09.852113 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:08:09Z', 'revision_number': 6, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:09.879546 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-023b6720-c847-40fa-b9c0-9d9d1d32f1fb None None] The sync data for ids ['b38ee346-0c33-4eb4-8342-134f3f715196'] in dv-cinder-master-3-iscsi is: [{'id': 'b38ee346-0c33-4eb4-8342-134f3f715196', 'name': 'tempest-TestShelveInstance-746329903-router', 'tenant_id': 'c3797435200949c8a45be6c5b0525dc0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:02:56Z', 'updated_at': '2022-01-05T15:08:09Z', 'revision_number': 6, 'project_id': 'c3797435200949c8a45be6c5b0525dc0', 'gw_port_host': None}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:08:10.013238 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.028234 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 req-0e70df8d-964e-4657-a6f5-dadec86559b7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:10.029796 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 req-0e70df8d-964e-4657-a6f5-dadec86559b7 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 945 time: 0.0545354 Jan 05 15:08:10.043862 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Pushing event deleted for resources: {'Port': ['ID=f52cee16-e7b4-4acc-9ce6-5dad24163904,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:10.080120 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c3f31be9-833c-441c-a8cc-df2af71f2ee2 req-8e91e4c5-2c56-498e-8377-275471187c5c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433121 Jan 05 15:08:10.111947 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.423025 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 81e8155b-5d11-486f-885b-dcbde5c4defc no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:08:10.464775 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 81e8155b-5d11-486f-885b-dcbde5c4defc {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:08:10.465143 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 81e8155b-5d11-486f-885b-dcbde5c4defc not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:08:10.495971 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.498106 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.610317 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.610877 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Fanout notify agent at l3_agent the message router_deleted on router b38ee346-0c33-4eb4-8342-134f3f715196 {{(pid=114655) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:08:10.615747 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.616991 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c85d3e3f-8819-40f8-bc6f-c75ff17cf41d admin admin] 10.222.0.30 "DELETE /v2.0/routers/b38ee346-0c33-4eb4-8342-134f3f715196 HTTP/1.1" status: 204 len: 168 time: 1.2574058 Jan 05 15:08:10.619500 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51312) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:10.663536 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] Deleting subnet c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:08:10.666607 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.702737 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.786668 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.943849 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.968833 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c3f10689-3a61-4de7-8ebe-99aa4c5a6a83,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:10.974923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:10.980987 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-b3c785a4-967b-40dc-8b9d-966dae93ecc3 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/c3f10689-3a61-4de7-8ebe-99aa4c5a6a83 HTTP/1.1" status: 204 len: 168 time: 0.3594098 Jan 05 15:08:10.981887 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98acf853-cf8d-4ae8-b462-8a5699a46779 None None] Network e5205e82-a517-4157-848a-78560d0d2806 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:08:10.987120 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51322) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:11.095535 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.164852 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Deleting port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:11.165449 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.190209 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] DHCP port deletion for e5205e82-a517-4157-848a-78560d0d2806 request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:08:11.233766 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] For port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:11.234147 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.246489 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] Deleting port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:11.246957 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.259234 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Calling delete_port for ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 owned by network:dhcp {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:11.331141 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] For port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,segment=NetworkSegment(fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b),segment_id=fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:11.332113 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.348417 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] Calling delete_port for ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:11.401172 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.421110 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.426896 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Pushing event deleted for resources: {'Port': ['ID=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:11.431415 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] No DVR routers for this DVR port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 on host dv-cinder-master-3-iscsi {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:08:11.450580 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] Pushing event deleted for resources: {'Port': ['ID=ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:11.454349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2b096de-c345-4e26-99ff-c392f39843d0 None None] No DVR routers for this DVR port ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:08:11.516022 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.537840 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e5205e82-a517-4157-848a-78560d0d2806']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:11.546842 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:11.547142 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fb8b268c-86e8-4bbf-9ffb-9c13c6057b1b') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:11.556212 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.569470 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.576076 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Releasing vlan 129 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:08:11.576393 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.578168 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:08:11.580477 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:08:11.697969 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.702753 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:11.708734 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] 10.222.0.30 "DELETE /v2.0/networks/e5205e82-a517-4157-848a-78560d0d2806 HTTP/1.1" status: 204 len: 168 time: 0.7198498 Jan 05 15:08:11.711461 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51354) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:11.731828 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13a80bcb-901f-46ab-b8f3-7e9bae20a662 admin admin] Pushing event deleted for resources: {'Network': ['ID=e5205e82-a517-4157-848a-78560d0d2806,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:12.094695 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:12.184425 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f52cee16-e7b4-4acc-9ce6-5dad24163904 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:08:12.209884 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: f52cee16-e7b4-4acc-9ce6-5dad24163904 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:08:12.211668 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f52cee16-e7b4-4acc-9ce6-5dad24163904 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:08:12.211668 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:08:12.231227 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:08:12.235549 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device ec1ea1b0-7356-4b4d-9f88-7cf3a2ec5bc9 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:08:12.361192 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Deleting port aff7dea8-8427-4fbd-a092-874fdaa8aad8 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:12.361192 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:12.437708 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] For port aff7dea8-8427-4fbd-a092-874fdaa8aad8, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=aff7dea8-8427-4fbd-a092-874fdaa8aad8,segment=NetworkSegment(aa897a0e-2f5f-409f-9c54-e54d16b8acdf),segment_id=aa897a0e-2f5f-409f-9c54-e54d16b8acdf)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:12.437982 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:12.451541 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Calling delete_port for aff7dea8-8427-4fbd-a092-874fdaa8aad8 owned by network:router_interface {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:12.720600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:12.751230 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Pushing event deleted for resources: {'Port': ['ID=aff7dea8-8427-4fbd-a092-874fdaa8aad8,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:12.919852 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:13.136854 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Router a3300cf8-c042-4d6e-a24f-3260216ca937 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:08:13.247835 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:08:13.256280 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0b7b7cbb-21fc-4516-a20f-aea470b7f5ed admin admin] 10.222.0.30 "PUT /v2.0/routers/a3300cf8-c042-4d6e-a24f-3260216ca937/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5408733 Jan 05 15:08:13.256280 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51366) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:13.261601 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] Sync routers for ids ['a3300cf8-c042-4d6e-a24f-3260216ca937'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:08:13.267895 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] Routers {'a3300cf8-c042-4d6e-a24f-3260216ca937'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:13.268515 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['a3300cf8-c042-4d6e-a24f-3260216ca937'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:13.366349 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks [] for router, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:13.384870 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] Set router a3300cf8-c042-4d6e-a24f-3260216ca937 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:13.469539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:13.567603 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87'}], 'enable_snat': True}, 'gw_port_id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:08:12Z', 'revision_number': 5, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port': {'id': '4ef02e08-ded0-413d-930b-b2d30049efc6', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:fc:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'device_owner': 'network:router_gateway', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:03:08Z', 'updated_at': '2022-01-05T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:13.594493 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] Checking router: a3300cf8-c042-4d6e-a24f-3260216ca937 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:08:13.603292 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] Routers {'a3300cf8-c042-4d6e-a24f-3260216ca937'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:13.603965 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['a3300cf8-c042-4d6e-a24f-3260216ca937'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:13.621432 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Deleting port 4ef02e08-ded0-413d-930b-b2d30049efc6 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:13.621797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:13.693476 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] Set router a3300cf8-c042-4d6e-a24f-3260216ca937 gateway port host: None {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:13.705052 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] For port 4ef02e08-ded0-413d-930b-b2d30049efc6, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ef02e08-ded0-413d-930b-b2d30049efc6,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:13.705444 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:13.718726 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Calling delete_port for 4ef02e08-ded0-413d-930b-b2d30049efc6 owned by network:router_gateway {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:13.746125 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:08:13Z', 'revision_number': 6, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:13.778288 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f420e3d0-5f43-4006-9f04-ce19a5c75a10 None None] The sync data for ids ['a3300cf8-c042-4d6e-a24f-3260216ca937'] in dv-cinder-master-3-iscsi is: [{'id': 'a3300cf8-c042-4d6e-a24f-3260216ca937', 'name': 'tempest-TestShelveInstance-1097934503-router', 'tenant_id': '876c395cd3f14110b4af4a7988e9b4c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:03:06Z', 'updated_at': '2022-01-05T15:08:13Z', 'revision_number': 6, 'project_id': '876c395cd3f14110b4af4a7988e9b4c1', 'gw_port_host': None}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:08:13.935846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:13.971012 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=4ef02e08-ded0-413d-930b-b2d30049efc6,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:14.038757 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.136379 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.138741 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.244448 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.244986 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a3300cf8-c042-4d6e-a24f-3260216ca937 {{(pid=114654) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:08:14.253405 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.253405 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-7117478e-de36-4c83-bcf5-cb560c6831d3 admin admin] 10.222.0.30 "DELETE /v2.0/routers/a3300cf8-c042-4d6e-a24f-3260216ca937 HTTP/1.1" status: 204 len: 168 time: 0.9936357 Jan 05 15:08:14.253405 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51374) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:14.301608 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_v2 [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] Deleting subnet 911a986a-d792-4f9a-89d1-a506c7e3b90e {{(pid=114654) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:08:14.304638 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.338277 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8770652'] for subnet, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.415883 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.537936 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device aff7dea8-8427-4fbd-a092-874fdaa8aad8 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:08:14.547761 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8855717', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8833888'] for subnet, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.562054 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: aff7dea8-8427-4fbd-a092-874fdaa8aad8 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:08:14.562054 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device aff7dea8-8427-4fbd-a092-874fdaa8aad8 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:08:14.583334 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=911a986a-d792-4f9a-89d1-a506c7e3b90e,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:14.588581 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.594144 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-de1b92f9-0895-4d17-9774-ff7c139907e5 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/911a986a-d792-4f9a-89d1-a506c7e3b90e HTTP/1.1" status: 204 len: 168 time: 0.3386333 Jan 05 15:08:14.594285 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdc4b034-2c03-465e-8dfe-d7fabfd582d5 None None] Network c1f8eb4e-612b-4878-8235-63de39015c64 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:08:14.595600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51376) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:14.670232 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.728400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Deleting port 11b871bd-555d-4adf-beee-7afb2e1e5b73 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:14.728735 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.745716 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] DHCP port deletion for c1f8eb4e-612b-4878-8235-63de39015c64 request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:08:14.799673 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] Deleting port 11b871bd-555d-4adf-beee-7afb2e1e5b73 {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:14.800374 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.800684 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] For port 11b871bd-555d-4adf-beee-7afb2e1e5b73, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=11b871bd-555d-4adf-beee-7afb2e1e5b73,segment=NetworkSegment(aa897a0e-2f5f-409f-9c54-e54d16b8acdf),segment_id=aa897a0e-2f5f-409f-9c54-e54d16b8acdf)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:14.801056 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.815998 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Calling delete_port for 11b871bd-555d-4adf-beee-7afb2e1e5b73 owned by network:dhcp {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:14.873841 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] For port 11b871bd-555d-4adf-beee-7afb2e1e5b73, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=11b871bd-555d-4adf-beee-7afb2e1e5b73,segment=NetworkSegment(aa897a0e-2f5f-409f-9c54-e54d16b8acdf),segment_id=aa897a0e-2f5f-409f-9c54-e54d16b8acdf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:14.874246 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.887697 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] Calling delete_port for 11b871bd-555d-4adf-beee-7afb2e1e5b73 owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:14.993815 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:14.999280 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:15.026812 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Pushing event deleted for resources: {'Port': ['ID=11b871bd-555d-4adf-beee-7afb2e1e5b73,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:15.031765 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] No DVR routers for this DVR port 11b871bd-555d-4adf-beee-7afb2e1e5b73 on host dv-cinder-master-3-iscsi {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:08:15.036737 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] Pushing event deleted for resources: {'Port': ['ID=11b871bd-555d-4adf-beee-7afb2e1e5b73,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:15.036737 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcb7472e-ea41-4c0b-8559-55d15383ee37 None None] No DVR routers for this DVR port 11b871bd-555d-4adf-beee-7afb2e1e5b73 on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:08:15.109444 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:15.135310 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c1f8eb4e-612b-4878-8235-63de39015c64']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:15.140669 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:15.140973 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa897a0e-2f5f-409f-9c54-e54d16b8acdf') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:15.152506 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:15.168979 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:15.176723 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:08:15.177197 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:08:15.178894 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:08:15.549628 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:15.558275 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:15.564122 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] 10.222.0.30 "DELETE /v2.0/networks/c1f8eb4e-612b-4878-8235-63de39015c64 HTTP/1.1" status: 204 len: 168 time: 0.9650526 Jan 05 15:08:15.572590 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b772afa0-fbe9-48d0-8d8c-89884953a2c6 admin admin] Pushing event deleted for resources: {'Network': ['ID=c1f8eb4e-612b-4878-8235-63de39015c64,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:15.980935 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51414) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:16.028674 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-e8473f61-cf47-4c93-9c6a-bd281c0afdba admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c3797435200949c8a45be6c5b0525dc0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0466015 Jan 05 15:08:16.031090 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51418) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:16.080620 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2651878c-5b5a-43ef-b899-9fb1d7cf2a1a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:16.103854 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2651878c-5b5a-43ef-b899-9fb1d7cf2a1a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:16.170139 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ef02e08-ded0-413d-930b-b2d30049efc6 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:08:16.192437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 4ef02e08-ded0-413d-930b-b2d30049efc6 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:08:16.192786 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 4ef02e08-ded0-413d-930b-b2d30049efc6 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:08:16.193410 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 11b871bd-555d-4adf-beee-7afb2e1e5b73 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:08:16.216686 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 11b871bd-555d-4adf-beee-7afb2e1e5b73 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:08:16.217042 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 11b871bd-555d-4adf-beee-7afb2e1e5b73 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:08:16.251883 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2651878c-5b5a-43ef-b899-9fb1d7cf2a1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:16.256031 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2651878c-5b5a-43ef-b899-9fb1d7cf2a1a admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:16.259516 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2651878c-5b5a-43ef-b899-9fb1d7cf2a1a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/00de9902-df4d-480c-8886-590d11a33750 HTTP/1.1" status: 204 len: 168 time: 0.2242937 Jan 05 15:08:16.265084 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2651878c-5b5a-43ef-b899-9fb1d7cf2a1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00de9902-df4d-480c-8886-590d11a33750,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:16.939598 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51442) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:16.979613 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-fb4c1e18-f0ad-486f-bba3-e9f7ce1c0e1d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=876c395cd3f14110b4af4a7988e9b4c1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0388091 Jan 05 15:08:16.982023 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51444) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:17.028950 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64607921-b076-40f5-8f50-7540929b1ad4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:17.049702 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64607921-b076-40f5-8f50-7540929b1ad4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:17.244438 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64607921-b076-40f5-8f50-7540929b1ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:17.247064 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-64607921-b076-40f5-8f50-7540929b1ad4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:17.249488 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-64607921-b076-40f5-8f50-7540929b1ad4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d50be4ef-f542-4cc9-aee0-07cf0a4e2761 HTTP/1.1" status: 204 len: 168 time: 0.2653227 Jan 05 15:08:17.256901 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64607921-b076-40f5-8f50-7540929b1ad4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d50be4ef-f542-4cc9-aee0-07cf0a4e2761,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:18.488800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51466) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:18.595032 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-906409d8-4862-445d-890f-b925efcd4249 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:18.667373 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-906409d8-4862-445d-890f-b925efcd4249 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:18.724317 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-906409d8-4862-445d-890f-b925efcd4249 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:18.762839 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-906409d8-4862-445d-890f-b925efcd4249 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7e02f9353cea4eaea7f1beedad4ca84a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2727056 Jan 05 15:08:18.764684 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906409d8-4862-445d-890f-b925efcd4249 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da68649a-d058-41b7-a08b-adef06c6e2e5,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:18.765574 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51470) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:18.814345 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-75a1d9c2-9d87-4e95-a148-80a5d7c48f76 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:18.836532 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-75a1d9c2-9d87-4e95-a148-80a5d7c48f76 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:19.003873 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-75a1d9c2-9d87-4e95-a148-80a5d7c48f76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:19.007082 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-75a1d9c2-9d87-4e95-a148-80a5d7c48f76 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:19.008216 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-75a1d9c2-9d87-4e95-a148-80a5d7c48f76 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/da68649a-d058-41b7-a08b-adef06c6e2e5 HTTP/1.1" status: 204 len: 168 time: 0.2404053 Jan 05 15:08:19.016216 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a1d9c2-9d87-4e95-a148-80a5d7c48f76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da68649a-d058-41b7-a08b-adef06c6e2e5,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:19.716556 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51478) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:19.730180 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2af7abef-204b-4028-a24c-8d5dc6bf0d1c admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:19.804772 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2af7abef-204b-4028-a24c-8d5dc6bf0d1c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:19.878424 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2af7abef-204b-4028-a24c-8d5dc6bf0d1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:19.918566 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2af7abef-204b-4028-a24c-8d5dc6bf0d1c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=198edb0421fc4733a791e01602e5fd7c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2006245 Jan 05 15:08:19.919486 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af7abef-204b-4028-a24c-8d5dc6bf0d1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f2074c2-2eab-4831-a6fd-08b8bc7f3ff7,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:19.921142 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51480) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:19.968888 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-71fd754a-a22a-4d62-b43a-a62a03d5f702 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:19.990615 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-71fd754a-a22a-4d62-b43a-a62a03d5f702 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:20.126520 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-71fd754a-a22a-4d62-b43a-a62a03d5f702 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:20.129243 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-71fd754a-a22a-4d62-b43a-a62a03d5f702 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:20.130290 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-71fd754a-a22a-4d62-b43a-a62a03d5f702 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7f2074c2-2eab-4831-a6fd-08b8bc7f3ff7 HTTP/1.1" status: 204 len: 168 time: 0.2081392 Jan 05 15:08:20.138717 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71fd754a-a22a-4d62-b43a-a62a03d5f702 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f2074c2-2eab-4831-a6fd-08b8bc7f3ff7,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:28.183349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4d05750b-7445-47fd-95fe-7a45a107e885 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:30.360095 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-97fdf814-73c7-421a-bc10-057239711b89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:31.883482 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:32.763866 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:33.541922 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51634) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:33.640459 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:33.778223 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1a6b3be3-06d7-4a70-b68a-43f3110e7c2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:33.853738 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1a6b3be3-06d7-4a70-b68a-43f3110e7c2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:33.920129 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1a6b3be3-06d7-4a70-b68a-43f3110e7c2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:33.957499 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1a6b3be3-06d7-4a70-b68a-43f3110e7c2e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=216f79b6ebc44d92b702aacc72834974&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4144707 Jan 05 15:08:33.958320 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a6b3be3-06d7-4a70-b68a-43f3110e7c2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89583af4-566d-44fe-a844-0aa5bfe2a677,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:33.960437 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51644) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:34.011824 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2579925c-987e-4272-8359-7224973a9fe4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:34.032644 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2579925c-987e-4272-8359-7224973a9fe4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:34.263446 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2579925c-987e-4272-8359-7224973a9fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:34.265995 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-2579925c-987e-4272-8359-7224973a9fe4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:34.267328 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-2579925c-987e-4272-8359-7224973a9fe4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/89583af4-566d-44fe-a844-0aa5bfe2a677 HTTP/1.1" status: 204 len: 168 time: 0.3058522 Jan 05 15:08:34.275944 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2579925c-987e-4272-8359-7224973a9fe4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89583af4-566d-44fe-a844-0aa5bfe2a677,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:34.532515 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.029520 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51652) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:35.042418 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d6335daa-8e3a-419f-a9dd-1a6fc63b6c8e admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.113802 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d6335daa-8e3a-419f-a9dd-1a6fc63b6c8e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.181606 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d6335daa-8e3a-419f-a9dd-1a6fc63b6c8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.218744 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d6335daa-8e3a-419f-a9dd-1a6fc63b6c8e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=05eecfab7b0545838340ed51b0e088b5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1881640 Jan 05 15:08:35.219614 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6335daa-8e3a-419f-a9dd-1a6fc63b6c8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f62846a-741e-42cd-a65d-a7307101ba5e,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:35.222120 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51654) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:35.269647 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cd450d7c-c172-4652-9860-702c8f532c03 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.290016 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cd450d7c-c172-4652-9860-702c8f532c03 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.399613 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cd450d7c-c172-4652-9860-702c8f532c03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.402706 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-cd450d7c-c172-4652-9860-702c8f532c03 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:35.403875 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-cd450d7c-c172-4652-9860-702c8f532c03 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2f62846a-741e-42cd-a65d-a7307101ba5e HTTP/1.1" status: 204 len: 168 time: 0.1807141 Jan 05 15:08:35.425670 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd450d7c-c172-4652-9860-702c8f532c03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f62846a-741e-42cd-a65d-a7307101ba5e,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:36.922263 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51688) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:37.021464 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8d85d195-660d-429d-9f10-374c9fde2f94 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:37.091077 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8d85d195-660d-429d-9f10-374c9fde2f94 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:37.217198 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-8d85d195-660d-429d-9f10-374c9fde2f94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:37.256763 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-8d85d195-660d-429d-9f10-374c9fde2f94 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7aaad94afc8a45a8b1affe0ca8d38b8a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3333924 Jan 05 15:08:37.258664 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d85d195-660d-429d-9f10-374c9fde2f94 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4959e97a-a4a5-4835-a235-b5ce402d8bc1,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:37.259520 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51692) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:37.306494 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-df2018e6-4276-4870-8f23-61ff18a3fb2a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:37.329291 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-df2018e6-4276-4870-8f23-61ff18a3fb2a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:37.432226 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-df2018e6-4276-4870-8f23-61ff18a3fb2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:37.434808 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-df2018e6-4276-4870-8f23-61ff18a3fb2a admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:37.438384 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-df2018e6-4276-4870-8f23-61ff18a3fb2a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4959e97a-a4a5-4835-a235-b5ce402d8bc1 HTTP/1.1" status: 204 len: 168 time: 0.1749437 Jan 05 15:08:37.443408 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2018e6-4276-4870-8f23-61ff18a3fb2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4959e97a-a4a5-4835-a235-b5ce402d8bc1,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:42.044540 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:08:45.130733 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51764) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:45.232992 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d27b8d8a-173b-4a85-aee1-d10012cd9bf4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:45.308258 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d27b8d8a-173b-4a85-aee1-d10012cd9bf4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:45.375169 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-d27b8d8a-173b-4a85-aee1-d10012cd9bf4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:45.411007 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27b8d8a-173b-4a85-aee1-d10012cd9bf4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c3f65d9-12b3-421d-bbe4-e48024cebc18,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:45.415361 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-d27b8d8a-173b-4a85-aee1-d10012cd9bf4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7fe0fadf1ece4860b6e03a0067c8cb9c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2836034 Jan 05 15:08:45.418521 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51768) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:45.464553 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b8b8ed93-9bbe-42dd-9524-6b448f20dddd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:45.485751 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b8b8ed93-9bbe-42dd-9524-6b448f20dddd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:45.615114 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b8b8ed93-9bbe-42dd-9524-6b448f20dddd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:45.617704 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-b8b8ed93-9bbe-42dd-9524-6b448f20dddd admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:45.618846 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-b8b8ed93-9bbe-42dd-9524-6b448f20dddd admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1c3f65d9-12b3-421d-bbe4-e48024cebc18 HTTP/1.1" status: 204 len: 168 time: 0.1998439 Jan 05 15:08:45.627100 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b8ed93-9bbe-42dd-9524-6b448f20dddd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c3f65d9-12b3-421d-bbe4-e48024cebc18,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:46.537664 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51792) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:46.630981 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-85557414-network', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:46.729229 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Made reservation on behalf of 4ed05f9412d9477ea62f75cd05af148b for: {'network': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:08:46.731522 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:46.740399 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:46.810936 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:46.879949 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:46.903930 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 128} {{(pid=114655) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:08:46.914954 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f998e68-33a5-440b-9104-322c45733a9c,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:46.919592 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:46.919932 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.segments_db [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Added segment 101c0dad-0651-4b26-b7e8-40146cbcf385 of type vlan for network b2bf0812-1bb3-4cbd-8030-193c492fed7f Jan 05 15:08:46.957692 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.068393 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.069296 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:47.069892 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.128989 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] Pushing event updated for resources: {'Network': ['ID=b2bf0812-1bb3-4cbd-8030-193c492fed7f,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:47.138910 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:08:47.189698 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2f55a6f3-cc1c-41ba-9a29-953c63fd96bb admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.6509600 Jan 05 15:08:47.192505 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51798) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:47.197174 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Request body: {'subnet': {'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-85557414-subnet', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'ip_version': 4}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:47.288980 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Made reservation on behalf of 4ed05f9412d9477ea62f75cd05af148b for: {'subnet': 1} {{(pid=114655) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:08:47.291259 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4267422'] for subnet, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.491561 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4701419', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4267372'] for subnet, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.544642 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Pushing event updated for resources: {'Subnet': ['ID=4edb11eb-ca12-4d58-bf53-1c547357436d,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:47.553630 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Checking segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114655) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:47.553987 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Network hostable DHCP agents. Network: b2bf0812-1bb3-4cbd-8030-193c492fed7f, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114655) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:08:47.626181 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114655) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:08:47.700562 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, b2bf0812-1bb3-4cbd-8030-193c492fed7f) {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:47.705390 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:47.705977 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.722212 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfd50978-5caa-458f-804e-4832de788559 None None] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:08:47.811367 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 15:08:47.812329 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.847083 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-00c763cb-4273-477c-92e0-ecad7a8dd07a admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6534941 Jan 05 15:08:47.849639 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51804) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:47.854095 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:47.946813 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.947923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:47.948725 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Allocated IP 172.20.0.2 (b2bf0812-1bb3-4cbd-8030-193c492fed7f/4edb11eb-ca12-4d58-bf53-1c547357436d/1bc44907-cc1e-4c5e-835d-e74411d2b8fe) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:08:48.002841 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.089152 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.206099 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.241298 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.245118 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:48.247940 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:48.252045 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:08:48.264274 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Pushing event updated for resources: {'Port': ['ID=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:48.309541 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Attempting to bind port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:08:48.309914 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Attempting to bind port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:08:48.310280 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Attempting to bind port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:08:48.315912 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 8, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:08:48.316291 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Checking segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:48.316687 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.317093 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Bound using segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:08:48.317691 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Bound port: 1bc44907-cc1e-4c5e-835d-e74411d2b8fe, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:08:48.318069 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.380081 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] For port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:08:48.385892 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] For port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:08:48.463041 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.483544 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.503641 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.524581 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111f16ef-e158-4e09-930c-b4d7deb5324f None None] Pushing event updated for resources: {'Port': ['ID=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:48.606009 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Allocated IP 172.37.2.198 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/f99d056f-803f-40aa-a291-1a136c991838) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:08:48.725202 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.861468 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:48.898506 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:48.901419 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:48.904731 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:08:48.914357 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Pushing event updated for resources: {'Port': ['ID=f99d056f-803f-40aa-a291-1a136c991838,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:49.258600 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:49.415669 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4dd53b5-d73a-485c-991d-bcd327a4e1fb None None] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:08:49.461092 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:49.524159 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-4f5d9979-b100-4ccb-b159-186176d6ca8c None None] Provisioning complete for port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:49.524483 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4f5d9979-b100-4ccb-b159-186176d6ca8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:49.609642 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4f5d9979-b100-4ccb-b159-186176d6ca8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:49.643236 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-4f5d9979-b100-4ccb-b159-186176d6ca8c None None] For port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:49.668449 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114655) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 15:08:49.723570 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4f5d9979-b100-4ccb-b159-186176d6ca8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:49.776459 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f5d9979-b100-4ccb-b159-186176d6ca8c None None] Pushing event updated for resources: {'Port': ['ID=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:49.776843 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:08:49.785588 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:08:49.796662 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:49.797343 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:49.860019 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-72e93482-ce58-4fe4-9982-b196b67bb48a None None] Provisioning complete for port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:49.860387 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-72e93482-ce58-4fe4-9982-b196b67bb48a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:49.869479 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:49.870759 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f92a5e23-6801-4f56-9a63-f87d292791b8 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.0202005 Jan 05 15:08:49.873694 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51814) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:49.941711 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:50.167259 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:49Z', 'revision_number': 3, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:50.198952 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:08:50.199334 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Updating router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 port f99d056f-803f-40aa-a291-1a136c991838 binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:08:50.227443 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.251044 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 1bc44907-cc1e-4c5e-835d-e74411d2b8fe up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:08:50.296837 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.391913 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:50.392349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.456291 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Allocated IP 172.20.0.1 (b2bf0812-1bb3-4cbd-8030-193c492fed7f/4edb11eb-ca12-4d58-bf53-1c547357436d/c44620a0-1161-4c55-aaa8-b10782655b55) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:08:50.565904 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.732148 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.805753 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.858462 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Attempting to bind port f99d056f-803f-40aa-a291-1a136c991838 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:08:50.859313 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Attempting to bind port f99d056f-803f-40aa-a291-1a136c991838 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:08:50.859680 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Attempting to bind port f99d056f-803f-40aa-a291-1a136c991838 on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:08:50.866899 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d087b3a-21cc-4055-bde4-65df087028c9 None None] Pushing event updated for resources: {'Port': ['ID=f99d056f-803f-40aa-a291-1a136c991838,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:50.872759 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 8, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:08:50.873181 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:50.874025 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.874025 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:08:50.874481 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Bound port: f99d056f-803f-40aa-a291-1a136c991838, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:08:50.875378 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.903109 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:50.925538 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] For port f99d056f-803f-40aa-a291-1a136c991838, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:08:50.928734 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] For port f99d056f-803f-40aa-a291-1a136c991838, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f99d056f-803f-40aa-a291-1a136c991838,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:08:50.940356 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:50.943703 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:50.946846 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:08:50.970835 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Pushing event updated for resources: {'Port': ['ID=c44620a0-1161-4c55-aaa8-b10782655b55,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:50.990529 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.028951 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.088929 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:51.089797 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:51.130554 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d087b3a-21cc-4055-bde4-65df087028c9 None None] Pushing event updated for resources: {'Port': ['ID=f99d056f-803f-40aa-a291-1a136c991838,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:51.179568 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.208133 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:51.278501 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-19bf9353-139a-45b5-aeb9-4a6321b76e66 None None] Provisioning complete for port c44620a0-1161-4c55-aaa8-b10782655b55 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:51.278757 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-19bf9353-139a-45b5-aeb9-4a6321b76e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.336524 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.352903 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-19bf9353-139a-45b5-aeb9-4a6321b76e66 None None] Port c44620a0-1161-4c55-aaa8-b10782655b55 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:08:51.388333 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.427206 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:49Z', 'revision_number': 3, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:51.454627 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-936427d0-c21e-48bb-8d6c-625770511eb0 None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:49Z', 'revision_number': 3, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:08:51.459284 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Pushing event updated for resources: {'Port': ['ID=c44620a0-1161-4c55-aaa8-b10782655b55,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:51.461812 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.563953 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:51.565326 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:51.727665 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:08:51.857208 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:08:51.862931 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4e6e6484-c466-4af3-8489-ed0b3a55004c admin admin] 10.222.0.30 "PUT /v2.0/routers/48ecabb4-e81a-4e10-9be8-f0c8dafe3995/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9882627 Jan 05 15:08:51.885789 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-02205aa0-f30b-44cd-9f75-46d9b9b42ada None None] Provisioning complete for port c44620a0-1161-4c55-aaa8-b10782655b55 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:51.886326 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-02205aa0-f30b-44cd-9f75-46d9b9b42ada None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:51.922706 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-02205aa0-f30b-44cd-9f75-46d9b9b42ada None None] Port c44620a0-1161-4c55-aaa8-b10782655b55 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:08:52.231952 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f99d056f-803f-40aa-a291-1a136c991838 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:08:52.299233 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port f99d056f-803f-40aa-a291-1a136c991838 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:52.299686 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:52.394979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:52.417247 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port f99d056f-803f-40aa-a291-1a136c991838, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f99d056f-803f-40aa-a291-1a136c991838,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:52.514570 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:52.570440 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=f99d056f-803f-40aa-a291-1a136c991838,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:52.646343 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51846) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:52.651679 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1006874219-network', 'tenant_id': '27c841a04bb44a3cae004da17444831e'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:52.771505 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Made reservation on behalf of 27c841a04bb44a3cae004da17444831e for: {'network': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:08:52.773873 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for network, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:52.786173 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:52.866653 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:52.986127 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.010960 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 109} {{(pid=114654) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jan 05 15:08:53.019731 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=641d876c-6fe1-4bf0-acd5-b0fbb0eb56e1,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:53.029800 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.030151 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.segments_db [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Added segment 63fc6b61-cca5-4ebe-ba1f-8b8860b029e9 of type vlan for network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 Jan 05 15:08:53.032336 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.032895 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.033282 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.033624 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.034120 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.034642 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.034980 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.035512 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.035834 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.036181 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.036497 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.036986 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.037348 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.052054 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:08:53.062771 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:53.063375 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:53.083077 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783775593476'] for network, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.166937 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:53.240347 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178'] for network, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.242266 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:53.243225 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.344997 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] Pushing event updated for resources: {'Network': ['ID=077dbc4f-d2ad-421e-98ea-6ea73bbf1021,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:53.356633 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 details requested by agent ovs-agent-dv-cinder-master-3-iscsi with host dv-cinder-master-3-iscsi {{(pid=114656) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Jan 05 15:08:53.362283 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78f7bac6-64c8-422a-8f08-eef3d3631b4e req-0859394b-d819-4fac-b49a-73f9aedfef40 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:53.364089 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-78f7bac6-64c8-422a-8f08-eef3d3631b4e req-0859394b-d819-4fac-b49a-73f9aedfef40 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 945 time: 0.1170528 Jan 05 15:08:53.388673 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0a0133a2-778e-46de-8666-de05b799b03a admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7408412 Jan 05 15:08:53.391617 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51854) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:53.396897 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Request body: {'subnet': {'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1006874219-subnet', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'ip_version': 4}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:53.439462 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-78f7bac6-64c8-422a-8f08-eef3d3631b4e req-fa9728f7-ebc6-44fc-b6e0-101b72dc0e40 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694172 Jan 05 15:08:53.483565 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 2, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:53.509367 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:08:53.509724 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Updating router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 port c44620a0-1161-4c55-aaa8-b10782655b55 binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:08:53.514156 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Made reservation on behalf of 27c841a04bb44a3cae004da17444831e for: {'subnet': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:08:53.516596 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8833947'] for subnet, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.534311 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.748405 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8855778', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8833897'] for subnet, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.796418 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.807542 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1d5581de-8632-4b05-b9b6-2aa5d45476b7,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:53.816322 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Checking segment: {'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:53.816686 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Network hostable DHCP agents. Network: 077dbc4f-d2ad-421e-98ea-6ea73bbf1021, hostable agents: ['f4714513-3ca4-465b-a959-baf0ba4a4c94'], hosted agents: [] {{(pid=114654) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jan 05 15:08:53.866128 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.895489 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 is scheduled to be hosted by DHCP agent f4714513-3ca4-465b-a959-baf0ba4a4c94 with binding_index 1 {{(pid=114654) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jan 05 15:08:53.916210 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Pushing event updated for resources: {'Port': ['ID=c44620a0-1161-4c55-aaa8-b10782655b55,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:53.938574 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.938948 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.939298 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.939647 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.939977 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.940306 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.940636 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.940972 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.941350 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.941669 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.941996 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.942318 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.942638 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114657) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:53.974453 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Attempting to bind port c44620a0-1161-4c55-aaa8-b10782655b55 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:08:53.980306 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Attempting to bind port c44620a0-1161-4c55-aaa8-b10782655b55 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:08:53.980306 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Attempting to bind port c44620a0-1161-4c55-aaa8-b10782655b55 on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:08:53.980633 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 8, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:08:53.981001 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Checking segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:53.981427 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:53.981816 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Bound using segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:08:53.982277 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Bound port: c44620a0-1161-4c55-aaa8-b10782655b55, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:08:53.982669 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.005647 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-master-3-iscsi, 077dbc4f-d2ad-421e-98ea-6ea73bbf1021) {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:54.011435 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:54.014557 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for subnet, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.017441 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-210b6946-4937-474d-91f3-998f1f9035b1 None None] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:08:54.055240 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] For port c44620a0-1161-4c55-aaa8-b10782655b55, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:08:54.058611 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] For port c44620a0-1161-4c55-aaa8-b10782655b55, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c44620a0-1161-4c55-aaa8-b10782655b55,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:08:54.117628 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-0163e0ae-6aaf-4304-ae35-cc434a8e7526 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.7243471 Jan 05 15:08:54.120052 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51856) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:54.124025 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-077dbc4f-d2ad-421e-98ea-6ea73bbf1021', 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021', 'project_id': '27c841a04bb44a3cae004da17444831e', 'fixed_ips': [{'subnet_id': '1d5581de-8632-4b05-b9b6-2aa5d45476b7'}]}} from dv-cinder-master-3-iscsi. {{(pid=114656) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Jan 05 15:08:54.124190 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:54.125448 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.165272 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.206048 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f99d056f-803f-40aa-a291-1a136c991838 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:08:54.207354 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:54.208192 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:54.251580 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-716642', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-123377'] for router, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.253293 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-713458', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-694637', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-654827', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-123368'] for router, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.268653 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-82faa20a-8b2e-4a5e-b1f6-b088da4224bf None None] Provisioning complete for port c44620a0-1161-4c55-aaa8-b10782655b55 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:54.268653 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-82faa20a-8b2e-4a5e-b1f6-b088da4224bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.321361 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.327486 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:54.353050 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e45ac4-22c9-4b73-969a-28f5fa2c9a28 None None] Pushing event updated for resources: {'Port': ['ID=c44620a0-1161-4c55-aaa8-b10782655b55,revision_number=4']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:54.353200 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.db_base_plugin_common [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Allocated IP 172.20.0.2 (077dbc4f-d2ad-421e-98ea-6ea73bbf1021/1d5581de-8632-4b05-b9b6-2aa5d45476b7/9dc6509e-d962-4409-a8ef-5494b3ff8a64) {{(pid=114656) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:08:54.374887 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port f99d056f-803f-40aa-a291-1a136c991838 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:54.375536 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.490884 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-82faa20a-8b2e-4a5e-b1f6-b088da4224bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.563704 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.567022 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632ea895-0781-4eca-a6f8-0067887b337e req-cdd6dddf-5009-4c6d-bbb4-c0609d324113 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:54.572844 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:54.574989 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-632ea895-0781-4eca-a6f8-0067887b337e req-cdd6dddf-5009-4c6d-bbb4-c0609d324113 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 945 time: 0.0583749 Jan 05 15:08:54.604758 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb252234-7535-4679-8763-146a3b2a8c80 None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:08:54.613623 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-82faa20a-8b2e-4a5e-b1f6-b088da4224bf None None] For port c44620a0-1161-4c55-aaa8-b10782655b55, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c44620a0-1161-4c55-aaa8-b10782655b55,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:54.627892 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-632ea895-0781-4eca-a6f8-0067887b337e req-fc209b87-2c8a-4bda-a0a3-737260ad84f0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518572 Jan 05 15:08:54.689495 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Publish callbacks [] for port, precommit_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.718194 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-82faa20a-8b2e-4a5e-b1f6-b088da4224bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.769931 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82faa20a-8b2e-4a5e-b1f6-b088da4224bf None None] Pushing event updated for resources: {'Port': ['ID=c44620a0-1161-4c55-aaa8-b10782655b55,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:54.835404 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637'] for port, after_create {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.864880 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-cfbe6b7f-9215-41f0-9301-f2ab309a14f8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:08:54.866365 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-cfbe6b7f-9215-41f0-9301-f2ab309a14f8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 945 time: 0.0937672 Jan 05 15:08:54.883025 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 is already hosted by enough agents. {{(pid=114656) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:54.883927 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-3362b71d-12a4-483c-a30f-237117dd8952 None None] Provisioning complete for port c44620a0-1161-4c55-aaa8-b10782655b55 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:54.884300 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3362b71d-12a4-483c-a30f-237117dd8952 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.890264 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.scheduler.base_scheduler [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Resources bound (agent type, host, resource id): {{(pid=114656) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:54.914597 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Received port after_create {{(pid=114656) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:08:54.932460 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Pushing event updated for resources: {'Port': ['ID=9dc6509e-d962-4409-a8ef-5494b3ff8a64,revision_number=1']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:54.990709 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Attempting to bind port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:08:54.991084 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Attempting to bind port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:08:54.991452 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Attempting to bind port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 on network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:08:54.995441 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:54.999947 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 8, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:08:55.000328 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Checking segment: {'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:55.000732 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.001161 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Bound using segment: {'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:08:55.001645 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Bound port: 9dc6509e-d962-4409-a8ef-5494b3ff8a64, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:08:55.002029 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.018267 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.112812 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] For port 9dc6509e-d962-4409-a8ef-5494b3ff8a64, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:08:55.117040 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] For port 9dc6509e-d962-4409-a8ef-5494b3ff8a64, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9dc6509e-d962-4409-a8ef-5494b3ff8a64,segment=NetworkSegment(63fc6b61-cca5-4ebe-ba1f-8b8860b029e9),segment_id=63fc6b61-cca5-4ebe-ba1f-8b8860b029e9)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:08:55.120890 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Deleting port e0bb8034-8d8b-416c-acf5-c75f60e6f363 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:08:55.121329 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.171841 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.192924 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Allocated IP 172.37.2.222 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/6cbe9e56-59b3-4632-a4e2-33bae465598c) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:08:55.246026 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eba54f3-1a53-43b6-9632-8e804778d2da None None] Pushing event updated for resources: {'Port': ['ID=9dc6509e-d962-4409-a8ef-5494b3ff8a64,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:55.295982 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] For port e0bb8034-8d8b-416c-acf5-c75f60e6f363, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e0bb8034-8d8b-416c-acf5-c75f60e6f363,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:55.296404 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.313109 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling delete_port for e0bb8034-8d8b-416c-acf5-c75f60e6f363 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:08:55.415868 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.600152 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.631527 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.641440 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:55.649798 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:55.669231 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['e0bb8034-8d8b-416c-acf5-c75f60e6f363'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:08:55.669923 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:08:55.674786 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Pushing event updated for resources: {'Port': ['ID=6cbe9e56-59b3-4632-a4e2-33bae465598c,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:55.776755 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Pushing event deleted for resources: {'Port': ['ID=e0bb8034-8d8b-416c-acf5-c75f60e6f363,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:55.782095 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b8b03706-f59d-4ad2-a241-fcec57deb7d3 req-18f93ef6-f499-48de-a29a-6ead4dcbc6c8 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 210 time: 0.0701914 Jan 05 15:08:55.805324 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] No DVR routers for this DVR port e0bb8034-8d8b-416c-acf5-c75f60e6f363 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:08:55.808367 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:55.813604 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b4a98ab0-80ef-42c6-90c6-ac161f51dbb8 req-75f9f27f-7abe-48cb-88b4-45e303613f9e tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "DELETE /v2.0/ports/e0bb8034-8d8b-416c-acf5-c75f60e6f363 HTTP/1.1" status: 204 len: 173 time: 0.9215095 Jan 05 15:08:55.814067 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'name': 'network-vif-deleted', 'tag': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:08:55.816894 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b289793-179f-414a-83c3-8d5338ff772d" -d '{"events": [{"server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "name": "network-vif-deleted", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:08:55.858107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:08:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-acccc299-e36a-4450-8bdb-ef3c42671696 x-openstack-request-id: req-acccc299-e36a-4450-8bdb-ef3c42671696 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:08:55.858399 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4", "name": "network-vif-deleted", "tag": "e0bb8034-8d8b-416c-acf5-c75f60e6f363", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:08:55.858681 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-acccc299-e36a-4450-8bdb-ef3c42671696 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:08:55.859082 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4', 'name': 'network-vif-deleted', 'tag': 'e0bb8034-8d8b-416c-acf5-c75f60e6f363', 'status': 'completed', 'code': 200} Jan 05 15:08:56.171714 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.210871 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89fe7ad2-bf33-434b-87e8-7083fc69e9ee None None] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:08:56.288271 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device c44620a0-1161-4c55-aaa8-b10782655b55 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:08:56.337971 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-816df570-23ae-4446-8cbd-495f1856597d None None] Provisioning complete for port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:56.338338 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-816df570-23ae-4446-8cbd-495f1856597d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.401308 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-713451', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-714170'] for router, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.420726 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port c44620a0-1161-4c55-aaa8-b10782655b55 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:56.421167 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.497553 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-816df570-23ae-4446-8cbd-495f1856597d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.566708 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-816df570-23ae-4446-8cbd-495f1856597d None None] For port 9dc6509e-d962-4409-a8ef-5494b3ff8a64, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9dc6509e-d962-4409-a8ef-5494b3ff8a64,segment=NetworkSegment(63fc6b61-cca5-4ebe-ba1f-8b8860b029e9),segment_id=63fc6b61-cca5-4ebe-ba1f-8b8860b029e9)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:08:56.576364 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 9dc6509e-d962-4409-a8ef-5494b3ff8a64 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:08:56.617625 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Router b871035c-7095-4390-8b45-783b4fcedacd is scheduled to L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f with binding_index 1 {{(pid=114654) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Jan 05 15:08:56.725858 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-816df570-23ae-4446-8cbd-495f1856597d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.734177 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:08:56.755665 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Sync routers for ids ['b871035c-7095-4390-8b45-783b4fcedacd'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:08:56.792849 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Routers {'b871035c-7095-4390-8b45-783b4fcedacd'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:56.793508 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b871035c-7095-4390-8b45-783b4fcedacd'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:56.813534 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.815116 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-c82ed51c-e82d-48a3-b7e1-d02f41fa37a6 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.6942103 Jan 05 15:08:56.817868 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51866) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:56.841802 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816df570-23ae-4446-8cbd-495f1856597d None None] Pushing event updated for resources: {'Port': ['ID=9dc6509e-d962-4409-a8ef-5494b3ff8a64,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:56.863194 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:56.863571 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.929052 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-b8ff0253-b06b-4911-9f63-612bab51465c None None] Provisioning complete for port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:56.929455 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b8ff0253-b06b-4911-9f63-612bab51465c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:56.985481 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Set router b871035c-7095-4390-8b45-783b4fcedacd gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:57.189366 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-6fe5e75f-ff00-471d-b9a3-590df65704b3 req-8e24486e-42d7-4740-b2d5-ec56272b950b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=80136f7d-a0c4-46e3-a5ae-e1c33e6d0ed4 HTTP/1.1" status: 200 len: 210 time: 0.3176215 Jan 05 15:08:57.245584 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222'}], 'enable_snat': True}, 'gw_port_id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:08:55Z', 'revision_number': 3, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port': {'id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:39:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:55Z', 'updated_at': '2022-01-05T15:08:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:57.272499 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Checking router: b871035c-7095-4390-8b45-783b4fcedacd for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:08:57.272859 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Updating router b871035c-7095-4390-8b45-783b4fcedacd port 6cbe9e56-59b3-4632-a4e2-33bae465598c binding host dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:08:57.296674 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.512137 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.552619 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Publish callbacks [] for port, precommit_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.634125 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.662392 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Allocated IP 172.20.0.1 (077dbc4f-d2ad-421e-98ea-6ea73bbf1021/1d5581de-8632-4b05-b9b6-2aa5d45476b7/8abed7e2-daac-4fa3-af28-a301fb6ca12d) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:08:57.685973 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Attempting to bind port 6cbe9e56-59b3-4632-a4e2-33bae465598c on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:08:57.686354 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Attempting to bind port 6cbe9e56-59b3-4632-a4e2-33bae465598c by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:08:57.687332 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Attempting to bind port 6cbe9e56-59b3-4632-a4e2-33bae465598c on network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:08:57.689272 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f889da33-8695-42c3-830e-b94d09c9cdd6 None None] Pushing event updated for resources: {'Port': ['ID=6cbe9e56-59b3-4632-a4e2-33bae465598c,revision_number=2']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:57.694854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 8, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:08:57.698289 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Checking segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114656) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:08:57.698289 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.698289 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Bound using segment: {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'} {{(pid=114656) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:08:57.698289 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.managers [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Bound port: 6cbe9e56-59b3-4632-a4e2-33bae465598c, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eadfff16-a9dd-467f-8d2f-7ca3a3571fcf', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9'}}] {{(pid=114656) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:08:57.698289 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.747287 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] For port 6cbe9e56-59b3-4632-a4e2-33bae465598c, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114656) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:08:57.750990 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] For port 6cbe9e56-59b3-4632-a4e2-33bae465598c, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6cbe9e56-59b3-4632-a4e2-33bae465598c,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:08:57.768031 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.837755 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.866230 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:57.895844 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Routers {'b871035c-7095-4390-8b45-783b4fcedacd'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:57.896461 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b871035c-7095-4390-8b45-783b4fcedacd'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:57.903238 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:57.906772 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:57.910196 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:08:57.918224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Pushing event updated for resources: {'Port': ['ID=8abed7e2-daac-4fa3-af28-a301fb6ca12d,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:57.934184 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f889da33-8695-42c3-830e-b94d09c9cdd6 None None] Pushing event updated for resources: {'Port': ['ID=6cbe9e56-59b3-4632-a4e2-33bae465598c,revision_number=3']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:57.954465 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-714093'] for router_interface, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.010703 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] Set router b871035c-7095-4390-8b45-783b4fcedacd gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:08:58.152317 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.201626 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 9dc6509e-d962-4409-a8ef-5494b3ff8a64 up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:08:58.234145 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f8a29a0c-b0ac-46cd-abf4-d8af32ee7088 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.257232 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-921843df-ec37-4a7d-9801-013db0c93a1e None None] Provisioning complete for port 8abed7e2-daac-4fa3-af28-a301fb6ca12d triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:58.257553 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-921843df-ec37-4a7d-9801-013db0c93a1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.283864 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222'}], 'enable_snat': True}, 'gw_port_id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:08:55Z', 'revision_number': 3, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port': {'id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:39:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:55Z', 'updated_at': '2022-01-05T15:08:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:58.320175 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2151cf00-851e-4a46-b934-04e417d58da3 None None] The sync data for ids ['b871035c-7095-4390-8b45-783b4fcedacd'] in dv-cinder-master-3-iscsi is: [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222'}], 'enable_snat': True}, 'gw_port_id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:08:55Z', 'revision_number': 3, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port': {'id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:39:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:55Z', 'updated_at': '2022-01-05T15:08:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:08:58.333556 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-921843df-ec37-4a7d-9801-013db0c93a1e None None] Port 8abed7e2-daac-4fa3-af28-a301fb6ca12d cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:08:58.334237 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.344550 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:58.345548 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.448819 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.523402 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1030352', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-713725'] for router_interface, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:58.533111 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Pushing event updated for resources: {'Port': ['ID=8abed7e2-daac-4fa3-af28-a301fb6ca12d,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:58.630707 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:08:58.632110 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:08:58.776619 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Router b871035c-7095-4390-8b45-783b4fcedacd has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:08:58.901600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:08:58.906823 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-12958518-f803-4b63-90ac-b7cf6d15939b admin admin] 10.222.0.30 "PUT /v2.0/routers/b871035c-7095-4390-8b45-783b4fcedacd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0877962 Jan 05 15:08:58.967519 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-3ca879c1-5937-4a74-a86b-e8c099276689 None None] Provisioning complete for port 8abed7e2-daac-4fa3-af28-a301fb6ca12d triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:08:58.968572 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3ca879c1-5937-4a74-a86b-e8c099276689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:59.015658 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-3ca879c1-5937-4a74-a86b-e8c099276689 None None] Port 8abed7e2-daac-4fa3-af28-a301fb6ca12d cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:08:59.494146 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51880) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:59.498923 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-369949876', 'description': 'tempest-secgroup-smoke-369949876 description', 'project_id': '4ed05f9412d9477ea62f75cd05af148b'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:59.588106 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:59.654761 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:59.730903 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:59.763222 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a2c3d224-9c0a-4ff5-980a-10e9592f96c9,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:08:59.770812 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.771169 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.771513 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.771853 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.772180 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.772505 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.772832 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.773183 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.773510 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.773841 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.774164 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.774507 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.774824 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:08:59.830720 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:59.832037 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-f82485d8-f2ec-4c16-adaf-5048d324b372 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.3367589 Jan 05 15:08:59.834966 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51884) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:08:59.839377 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-45219efb-0ecd-41da-a828-96bbac4329a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'security_group_rule': {'security_group_id': 'a2c3d224-9c0a-4ff5-980a-10e9592f96c9', 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:08:59.885177 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Sync routers for ids ['b871035c-7095-4390-8b45-783b4fcedacd'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:08:59.895071 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Routers {'b871035c-7095-4390-8b45-783b4fcedacd'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:08:59.895601 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:08:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b871035c-7095-4390-8b45-783b4fcedacd'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:08:59.930491 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-45219efb-0ecd-41da-a828-96bbac4329a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:59.985447 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-45219efb-0ecd-41da-a828-96bbac4329a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:08:59.998789 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Set router b871035c-7095-4390-8b45-783b4fcedacd gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:09:00.062875 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-45219efb-0ecd-41da-a828-96bbac4329a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.081484 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45219efb-0ecd-41da-a828-96bbac4329a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f2e3e30c-ca3b-4248-90f1-359c1e9886f8,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:00.191042 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-45219efb-0ecd-41da-a828-96bbac4329a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.192801 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-45219efb-0ecd-41da-a828-96bbac4329a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3566625 Jan 05 15:09:00.195417 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51886) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:09:00.200396 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-82911133-012e-409a-a256-09a88ee81254 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'security_group_rule': {'security_group_id': 'a2c3d224-9c0a-4ff5-980a-10e9592f96c9', 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:00.204013 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222'}], 'enable_snat': True}, 'gw_port_id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:08:58Z', 'revision_number': 4, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port': {'id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:39:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:55Z', 'updated_at': '2022-01-05T15:08:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '8abed7e2-daac-4fa3-af28-a301fb6ca12d', 'name': '', 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'mac_address': 'fa:16:3e:67:4b:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '1d5581de-8632-4b05-b9b6-2aa5d45476b7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:57Z', 'updated_at': '2022-01-05T15:08:58Z', 'revision_number': 2, 'project_id': '27c841a04bb44a3cae004da17444831e', 'subnets': [{'id': '1d5581de-8632-4b05-b9b6-2aa5d45476b7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:09:00.230763 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6cbe9e56-59b3-4632-a4e2-33bae465598c up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:09:00.235257 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Checking router: b871035c-7095-4390-8b45-783b4fcedacd for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:09:00.235617 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Updating router b871035c-7095-4390-8b45-783b4fcedacd port 8abed7e2-daac-4fa3-af28-a301fb6ca12d binding host dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jan 05 15:09:00.261668 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.279611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 6cbe9e56-59b3-4632-a4e2-33bae465598c triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:00.279983 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.370877 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.382074 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-82911133-012e-409a-a256-09a88ee81254 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.392702 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] For port 6cbe9e56-59b3-4632-a4e2-33bae465598c, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6cbe9e56-59b3-4632-a4e2-33bae465598c,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:00.446762 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-82911133-012e-409a-a256-09a88ee81254 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.477526 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-3fda11fb-eb0c-4ae3-95ae-215c1d5a0885 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.506232 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.510000 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-82911133-012e-409a-a256-09a88ee81254 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.531076 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82911133-012e-409a-a256-09a88ee81254 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17a90a43-77b1-4cbf-b52b-bb078ded83f0,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:00.554670 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Publish callbacks [] for port, precommit_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.558661 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Pushing event updated for resources: {'Port': ['ID=6cbe9e56-59b3-4632-a4e2-33bae465598c,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:00.593921 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-82911133-012e-409a-a256-09a88ee81254 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.595132 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-82911133-012e-409a-a256-09a88ee81254 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3986766 Jan 05 15:09:00.602469 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 51888) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:09:00.606730 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [None req-f7ebd4fd-b7ed-4403-9755-f601008db5ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'security_group_rule': {'security_group_id': 'a2c3d224-9c0a-4ff5-980a-10e9592f96c9', 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:00.620093 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.651425 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device e0bb8034-8d8b-416c-acf5-c75f60e6f363 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:09:00.667931 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84662e3-2e8e-4a72-bdba-691fe4b9a300 None None] Pushing event updated for resources: {'Port': ['ID=8abed7e2-daac-4fa3-af28-a301fb6ca12d,revision_number=3']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:00.674626 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: e0bb8034-8d8b-416c-acf5-c75f60e6f363 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:09:00.674969 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device e0bb8034-8d8b-416c-acf5-c75f60e6f363 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:09:00.712309 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f7ebd4fd-b7ed-4403-9755-f601008db5ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.740501 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Attempting to bind port 8abed7e2-daac-4fa3-af28-a301fb6ca12d on host dv-cinder-master-3-iscsi for vnic_type normal with profile {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:09:00.742946 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Attempting to bind port 8abed7e2-daac-4fa3-af28-a301fb6ca12d by drivers openvswitch,hyperv on host dv-cinder-master-3-iscsi at level 0 using segments [{'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:09:00.742946 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Attempting to bind port 8abed7e2-daac-4fa3-af28-a301fb6ca12d on network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:09:00.750138 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Checking agent: {'id': '00371a5a-2643-4500-b563-092a3720b8a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-master-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 51, 4), 'started_at': datetime.datetime(2022, 1, 5, 14, 51, 34), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 8, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-master-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:09:00.750608 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Checking segment: {'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114657) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:09:00.751072 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.751609 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Bound using segment: {'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'} {{(pid=114657) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:09:00.752497 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.managers [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Bound port: 8abed7e2-daac-4fa3-af28-a301fb6ca12d, host: dv-cinder-master-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021'}}] {{(pid=114657) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:09:00.752836 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.794738 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f7ebd4fd-b7ed-4403-9755-f601008db5ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.819865 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] For port 8abed7e2-daac-4fa3-af28-a301fb6ca12d, host dv-cinder-master-3-iscsi, cleared binding levels {{(pid=114657) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:09:00.823341 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.plugins.ml2.db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] For port 8abed7e2-daac-4fa3-af28-a301fb6ca12d, host dv-cinder-master-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8abed7e2-daac-4fa3-af28-a301fb6ca12d,segment=NetworkSegment(63fc6b61-cca5-4ebe-ba1f-8b8860b029e9),segment_id=63fc6b61-cca5-4ebe-ba1f-8b8860b029e9)] {{(pid=114657) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:09:00.885224 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f7ebd4fd-b7ed-4403-9755-f601008db5ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.904183 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ebd4fd-b7ed-4403-9755-f601008db5ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8c472486-99f0-45aa-b4b5-228c8e5e8464,revision_number=0']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:00.918256 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron_lib.callbacks.manager [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114657) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.946266 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-10cabcf8-ce15-42d4-a8b8-f64598b85d76 None None] Provisioning complete for port 8abed7e2-daac-4fa3-af28-a301fb6ca12d triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:00.946636 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-10cabcf8-ce15-42d4-a8b8-f64598b85d76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.963535 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Routers {'b871035c-7095-4390-8b45-783b4fcedacd'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:09:00.964246 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:09:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b871035c-7095-4390-8b45-783b4fcedacd'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:09:00.985509 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f7ebd4fd-b7ed-4403-9755-f601008db5ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:00.989255 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f7ebd4fd-b7ed-4403-9755-f601008db5ae tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3835235 Jan 05 15:09:00.989979 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51892) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:09:00.995000 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-c4ad1d70-8174-41bb-9f6e-1c6d96c9b8ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'security_group_rule': {'security_group_id': 'a2c3d224-9c0a-4ff5-980a-10e9592f96c9', 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:01.077691 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84662e3-2e8e-4a72-bdba-691fe4b9a300 None None] Pushing event updated for resources: {'Port': ['ID=8abed7e2-daac-4fa3-af28-a301fb6ca12d,revision_number=4']} {{(pid=114657) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:01.094805 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c4ad1d70-8174-41bb-9f6e-1c6d96c9b8ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.116736 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] Set router b871035c-7095-4390-8b45-783b4fcedacd gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:09:01.183776 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-10cabcf8-ce15-42d4-a8b8-f64598b85d76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.189307 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c4ad1d70-8174-41bb-9f6e-1c6d96c9b8ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.221051 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-10cabcf8-ce15-42d4-a8b8-f64598b85d76 None None] For port 8abed7e2-daac-4fa3-af28-a301fb6ca12d, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8abed7e2-daac-4fa3-af28-a301fb6ca12d,segment=NetworkSegment(63fc6b61-cca5-4ebe-ba1f-8b8860b029e9),segment_id=63fc6b61-cca5-4ebe-ba1f-8b8860b029e9)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:01.277665 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c4ad1d70-8174-41bb-9f6e-1c6d96c9b8ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.296123 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ad1d70-8174-41bb-9f6e-1c6d96c9b8ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2b949fcc-24ff-484c-b35e-d7d6044d5c96,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:01.306340 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-10cabcf8-ce15-42d4-a8b8-f64598b85d76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.354730 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10cabcf8-ce15-42d4-a8b8-f64598b85d76 None None] Pushing event updated for resources: {'Port': ['ID=8abed7e2-daac-4fa3-af28-a301fb6ca12d,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:01.384233 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c4ad1d70-8174-41bb-9f6e-1c6d96c9b8ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.385663 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c4ad1d70-8174-41bb-9f6e-1c6d96c9b8ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3946321 Jan 05 15:09:01.388370 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51896) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:09:01.393605 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'security_group_rule': {'security_group_id': 'a2c3d224-9c0a-4ff5-980a-10e9592f96c9', 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:01.425288 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222'}], 'enable_snat': True}, 'gw_port_id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:08:58Z', 'revision_number': 4, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port': {'id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:39:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:55Z', 'updated_at': '2022-01-05T15:09:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '8abed7e2-daac-4fa3-af28-a301fb6ca12d', 'name': '', 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'mac_address': 'fa:16:3e:67:4b:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '1d5581de-8632-4b05-b9b6-2aa5d45476b7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:57Z', 'updated_at': '2022-01-05T15:09:00Z', 'revision_number': 4, 'project_id': '27c841a04bb44a3cae004da17444831e', 'subnets': [{'id': '1d5581de-8632-4b05-b9b6-2aa5d45476b7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:09:01.426570 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-5af7ee79-6212-4805-a669-3abe982e3cd2 None None] Provisioning complete for port 8abed7e2-daac-4fa3-af28-a301fb6ca12d triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:01.426944 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5af7ee79-6212-4805-a669-3abe982e3cd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.453098 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e501e0-f538-4a9e-86be-4772e887f8cc None None] The sync data for ids ['b871035c-7095-4390-8b45-783b4fcedacd'] in dv-cinder-master-3-iscsi is: [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222'}], 'enable_snat': True}, 'gw_port_id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:08:58Z', 'revision_number': 4, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port': {'id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:39:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:55Z', 'updated_at': '2022-01-05T15:09:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': '8abed7e2-daac-4fa3-af28-a301fb6ca12d', 'name': '', 'network_id': '077dbc4f-d2ad-421e-98ea-6ea73bbf1021', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'mac_address': 'fa:16:3e:67:4b:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '1d5581de-8632-4b05-b9b6-2aa5d45476b7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:57Z', 'updated_at': '2022-01-05T15:09:00Z', 'revision_number': 4, 'project_id': '27c841a04bb44a3cae004da17444831e', 'subnets': [{'id': '1d5581de-8632-4b05-b9b6-2aa5d45476b7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:09:01.496838 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.securitygroups_db [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Project 4ed05f9412d9477ea62f75cd05af148b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jan 05 15:09:01.518374 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.590519 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.666150 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.688217 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=87aa62e7-3455-49b8-bb51-fc54f33cc831,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:01.759732 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.760970 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-c2a00823-8ec3-427e-9557-90ee88c4eedc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3716128 Jan 05 15:09:01.763871 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 51900) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:09:01.769386 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'security_group_rule': {'security_group_id': 'a2c3d224-9c0a-4ff5-980a-10e9592f96c9', 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:01.868215 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.902554 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.securitygroups_db [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Project 4ed05f9412d9477ea62f75cd05af148b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jan 05 15:09:01.908200 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:01.969470 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:02.048934 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631483'] for security_group_rule, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:02.068879 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a39de813-eb5e-4d72-a4ad-655e3b9e9bb5,revision_number=0']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:02.182931 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group_rule, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:02.184210 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d9262bf7-be80-4640-af5a-283353ba1362 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4192448 Jan 05 15:09:02.273401 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6cbe9e56-59b3-4632-a4e2-33bae465598c up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:09:02.329322 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 6cbe9e56-59b3-4632-a4e2-33bae465598c triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:02.330070 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:02.426152 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 8abed7e2-daac-4fa3-af28-a301fb6ca12d up at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:09:02.478339 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Provisioning complete for port 8abed7e2-daac-4fa3-af28-a301fb6ca12d triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:02.479139 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:02.793636 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:03.643195 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:04.399157 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:08.000628 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-d5320a29-178d-45fe-96a9-29697e103fe3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:08.002609 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-d5320a29-178d-45fe-96a9-29697e103fe3 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/networks?id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a HTTP/1.1" status: 200 len: 814 time: 0.1031251 Jan 05 15:09:08.016896 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-d6241a89-1dfc-487b-a508-ce2e5323b92b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/quotas/4ffa8c6fb14941c6ba03ddd2d63c49be HTTP/1.1" status: 200 len: 375 time: 0.0089200 Jan 05 15:09:08.052379 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-717aa62d-628d-4876-84c5-ddb4b5366066 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0303423 Jan 05 15:09:08.144498 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-d19e51a7-22a3-4817-8e34-0d394bb9d066 service neutron] 10.222.0.30 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845101 Jan 05 15:09:08.238890 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-f0543093-19e5-4bec-982e-c0f1800117d9 service neutron] 10.222.0.30 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883777 Jan 05 15:09:08.489099 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9e44f38-fee0-4b4d-b508-dd80b1afab11 req-d087f1c6-6085-4a23-8754-394baf20be00 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 210 time: 0.0295610 Jan 05 15:09:09.582407 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7d86bcbe-d49a-41ab-9933-2c7429f503a7 req-5ec50d7a-a7c2-4d14-8694-6444c8fa6d77 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 210 time: 0.0262799 Jan 05 15:09:10.522197 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-d4267ba3-27a5-4dac-b3c8-bf8350d37ec6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:10.523702 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-d4267ba3-27a5-4dac-b3c8-bf8350d37ec6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "GET /v2.0/networks?id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a HTTP/1.1" status: 200 len: 814 time: 0.1033659 Jan 05 15:09:10.543075 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Request body: {'port': {'device_id': '19df41f2-6b98-48a5-8198-d80388e39e73', 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a', 'admin_state_up': True, 'tenant_id': '4ffa8c6fb14941c6ba03ddd2d63c49be'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:10.683289 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1e8c1f3-8f80-44c9-9d6b-7eb7e26c8e27 req-20901b02-447d-4048-8def-02ca2f7f2f66 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 210 time: 0.0286746 Jan 05 15:09:10.753837 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Made reservation on behalf of 4ffa8c6fb14941c6ba03ddd2d63c49be for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:09:10.757489 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:10.887132 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Allocated IP 172.20.0.9 (4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a/d2a43a22-37fb-4c9b-bcbe-1e4cb1759710/538500aa-927f-4d3d-978d-d6e32e769918) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:09:11.035899 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:11.125571 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:11.170893 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:09:11.174504 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:09:11.178039 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:09:11.187001 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Pushing event updated for resources: {'Port': ['ID=538500aa-927f-4d3d-978d-d6e32e769918,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:11.232726 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:11.233352 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:11.316678 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-afb5b368-6aed-4dfa-9a24-395e00b3865a tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7773798 Jan 05 15:09:11.342743 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Request body: {'port': {'device_id': '19df41f2-6b98-48a5-8198-d80388e39e73', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:11.395263 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:11.665274 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 538500aa-927f-4d3d-978d-d6e32e769918 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:09:11.672629 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:11.684251 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Transition to ACTIVE for port object 538500aa-927f-4d3d-978d-d6e32e769918 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:09:11.776354 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:11.799611 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf744bba-b3d6-43ef-add1-52ca871578ca req-56d48c98-5e0f-4fe3-8e20-0a2b05939aea tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:11.801112 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bf744bba-b3d6-43ef-add1-52ca871578ca req-56d48c98-5e0f-4fe3-8e20-0a2b05939aea tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 931 time: 0.0518310 Jan 05 15:09:11.842071 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Pushing event updated for resources: {'Port': ['ID=538500aa-927f-4d3d-978d-d6e32e769918,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:11.849129 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bf744bba-b3d6-43ef-add1-52ca871578ca req-976b9e98-adba-4ef5-86b8-094503994d95 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421336 Jan 05 15:09:11.896427 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Attempting to bind port 538500aa-927f-4d3d-978d-d6e32e769918 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:09:11.896763 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Attempting to bind port 538500aa-927f-4d3d-978d-d6e32e769918 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:09:11.897121 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Attempting to bind port 538500aa-927f-4d3d-978d-d6e32e769918 on network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:09:11.901272 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Port 538500aa-927f-4d3d-978d-d6e32e769918 on network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:09:11.901601 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Attempting to bind port 538500aa-927f-4d3d-978d-d6e32e769918 on network 4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:09:11.906322 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 9, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:09:11.906660 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Checking segment: {'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:09:11.907043 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Bound using segment: {'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:09:11.907465 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Bound port: 538500aa-927f-4d3d-978d-d6e32e769918, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'eecb354a-4972-44ae-a5e5-e5fe7673ae43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:09:11.908413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:11.978786 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] For port 538500aa-927f-4d3d-978d-d6e32e769918, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:09:11.982107 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] For port 538500aa-927f-4d3d-978d-d6e32e769918, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=538500aa-927f-4d3d-978d-d6e32e769918,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:09:12.080672 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:12.116516 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:12.117164 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:12.127121 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] 10.222.0.13 "PUT /v2.0/ports/538500aa-927f-4d3d-978d-d6e32e769918 HTTP/1.1" status: 200 len: 1093 time: 0.7803020 Jan 05 15:09:12.127121 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '19df41f2-6b98-48a5-8198-d80388e39e73', 'tag': '538500aa-927f-4d3d-978d-d6e32e769918'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:09:12.127121 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acc038ca-d06b-48bd-88c9-290109a6f3be" -d '{"events": [{"name": "network-changed", "server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "tag": "538500aa-927f-4d3d-978d-d6e32e769918"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:09:12.145672 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56c4c6c5-5e31-4c71-9ef7-99e06146fda0 service neutron] Pushing event updated for resources: {'Port': ['ID=538500aa-927f-4d3d-978d-d6e32e769918,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:12.169934 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:09:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ca371b2-272d-4f7a-91b5-a40d0b545faf x-openstack-request-id: req-3ca371b2-272d-4f7a-91b5-a40d0b545faf {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:09:12.170223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "tag": "538500aa-927f-4d3d-978d-d6e32e769918", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:09:12.170479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3ca371b2-272d-4f7a-91b5-a40d0b545faf {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:09:12.170960 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '19df41f2-6b98-48a5-8198-d80388e39e73', 'tag': '538500aa-927f-4d3d-978d-d6e32e769918', 'status': 'completed', 'code': 200} Jan 05 15:09:12.252957 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-9b1862b3-8f0a-4b7f-aaf9-b7e3804ec567 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:12.254469 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-9b1862b3-8f0a-4b7f-aaf9-b7e3804ec567 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 1096 time: 0.0436239 Jan 05 15:09:12.357248 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-c03d6d24-97d9-4a93-b1b8-18baef4ecc9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:12.358680 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-c03d6d24-97d9-4a93-b1b8-18baef4ecc9a service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0904851 Jan 05 15:09:12.448626 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-19222231-76af-4757-95fe-81eb21940389 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:12.450133 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-acc038ca-d06b-48bd-88c9-290109a6f3be req-19222231-76af-4757-95fe-81eb21940389 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0854633 Jan 05 15:09:12.549465 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-bcd37744-b2c2-4234-aec7-ba7ba693d327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:12.550939 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-bcd37744-b2c2-4234-aec7-ba7ba693d327 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 1096 time: 0.0437315 Jan 05 15:09:12.597166 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-f1e5169a-9ecf-4021-b724-44f16a9e0c3c service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=538500aa-927f-4d3d-978d-d6e32e769918 HTTP/1.1" status: 200 len: 217 time: 0.0336821 Jan 05 15:09:12.642847 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-dac38052-e1bc-45b4-a7c5-a67b98a32902 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:12.644239 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-dac38052-e1bc-45b4-a7c5-a67b98a32902 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=d2a43a22-37fb-4c9b-bcbe-1e4cb1759710 HTTP/1.1" status: 200 len: 854 time: 0.0417013 Jan 05 15:09:12.677793 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-c4563b4e-02ce-43b2-9a47-21e1949f9f42 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0276668 Jan 05 15:09:12.765808 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-a8f778f1-f2b7-48a9-86bf-e1d7fb2055bc service neutron] 10.222.0.13 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810585 Jan 05 15:09:12.854941 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0692c0fa-0375-447e-aeee-ebe537f0d319 req-dc730257-ded1-43d2-8886-d558e1c20930 service neutron] 10.222.0.13 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828035 Jan 05 15:09:12.969634 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1fdec81-d33a-4c81-8172-0a3734e29f07 req-b23646d5-f0d6-4b19-ac0b-d59fd50c26fd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:12.971503 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d1fdec81-d33a-4c81-8172-0a3734e29f07 req-b23646d5-f0d6-4b19-ac0b-d59fd50c26fd tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 943 time: 0.0522459 Jan 05 15:09:13.016783 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-d1fdec81-d33a-4c81-8172-0a3734e29f07 req-6c4ee298-218d-4820-90f4-27f16723db2f tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394924 Jan 05 15:09:14.133281 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820f5aa0-52d4-456e-a21e-5b476f574df3 req-49aa52c2-e994-40fa-b0f3-913b8db69f83 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:14.134756 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-820f5aa0-52d4-456e-a21e-5b476f574df3 req-49aa52c2-e994-40fa-b0f3-913b8db69f83 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 943 time: 0.0515013 Jan 05 15:09:14.188033 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-820f5aa0-52d4-456e-a21e-5b476f574df3 req-e52c51ea-ab05-4501-8198-aa15637f7cf0 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475912 Jan 05 15:09:15.306251 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581ef3f1-481f-4096-8d69-84bcb2f2d069 req-6a96f251-9014-4e3e-821b-2bd195448eed tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:15.307716 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-581ef3f1-481f-4096-8d69-84bcb2f2d069 req-6a96f251-9014-4e3e-821b-2bd195448eed tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 943 time: 0.0476527 Jan 05 15:09:15.353328 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-581ef3f1-481f-4096-8d69-84bcb2f2d069 req-93d17bc2-ca2e-45ce-9513-727bc63b524b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401928 Jan 05 15:09:15.637690 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 538500aa-927f-4d3d-978d-d6e32e769918 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:09:15.736580 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 538500aa-927f-4d3d-978d-d6e32e769918, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=538500aa-927f-4d3d-978d-d6e32e769918,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:15.747737 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '538500aa-927f-4d3d-978d-d6e32e769918', 'network_id': '4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a', 'port_id': '538500aa-927f-4d3d-978d-d6e32e769918', 'mac_address': 'fa:16:3e:1c:3b:4f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd2a43a22-37fb-4c9b-bcbe-1e4cb1759710', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:09:15.783573 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:15.795508 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 538500aa-927f-4d3d-978d-d6e32e769918 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:09:15.814427 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 538500aa-927f-4d3d-978d-d6e32e769918, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=538500aa-927f-4d3d-978d-d6e32e769918,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:15.871110 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:15.921052 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=538500aa-927f-4d3d-978d-d6e32e769918,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:15.927890 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.928237 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.928577 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.928928 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.929275 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.929602 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.929925 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.930248 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.930567 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.930895 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.931215 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.931533 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:15.931848 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:09:16.197486 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['538500aa-927f-4d3d-978d-d6e32e769918'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:09:16.468295 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb req-7d9dbf3b-02da-47e9-ab87-32c12345fba9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:16.469724 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb req-7d9dbf3b-02da-47e9-ab87-32c12345fba9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 944 time: 0.0514255 Jan 05 15:09:16.515183 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-191e7f7a-9f26-43c1-b3df-fac6be84a1bb req-0f2bf619-7109-4781-9e3b-efbb6bf449d9 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399959 Jan 05 15:09:17.629962 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bee946a-d6f7-4b54-bb84-81bf87106db1 req-abb25c98-c21b-4b9e-acac-b8212f19061b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:17.631403 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1bee946a-d6f7-4b54-bb84-81bf87106db1 req-abb25c98-c21b-4b9e-acac-b8212f19061b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 944 time: 0.0475006 Jan 05 15:09:17.637511 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 538500aa-927f-4d3d-978d-d6e32e769918 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:09:17.682022 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1bee946a-d6f7-4b54-bb84-81bf87106db1 req-b99d48af-0f9c-4d71-9d1f-230e2fce04f6 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450671 Jan 05 15:09:17.725534 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 538500aa-927f-4d3d-978d-d6e32e769918 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:09:17.729443 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 538500aa-927f-4d3d-978d-d6e32e769918 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:17.730599 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:17.805831 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:17.828587 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19df41f2-6b98-48a5-8198-d80388e39e73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '538500aa-927f-4d3d-978d-d6e32e769918'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:09:17.831338 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6a71394-1362-421d-b7cc-859c5f739bf7" -d '{"events": [{"server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "name": "network-vif-plugged", "status": "completed", "tag": "538500aa-927f-4d3d-978d-d6e32e769918"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:09:17.844261 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 538500aa-927f-4d3d-978d-d6e32e769918, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=538500aa-927f-4d3d-978d-d6e32e769918,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:17.866776 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:09:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-977784d0-e81c-4bea-95da-cc021da6109c x-openstack-request-id: req-977784d0-e81c-4bea-95da-cc021da6109c {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:09:17.867068 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "name": "network-vif-plugged", "status": "completed", "tag": "538500aa-927f-4d3d-978d-d6e32e769918", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:09:17.867319 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-977784d0-e81c-4bea-95da-cc021da6109c {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:09:17.867726 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '19df41f2-6b98-48a5-8198-d80388e39e73', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '538500aa-927f-4d3d-978d-d6e32e769918', 'code': 200} Jan 05 15:09:17.930723 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:17.941164 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-82ddf396-4f28-40ba-8be5-8509272cad4b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-369949876&fields=id&tenant_id=4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 267 time: 0.0490296 Jan 05 15:09:17.986870 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=538500aa-927f-4d3d-978d-d6e32e769918,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:18.047213 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-706af2d9-e6ea-4b2a-a24c-268b44652234 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:18.048619 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-706af2d9-e6ea-4b2a-a24c-268b44652234 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 810 time: 0.1010795 Jan 05 15:09:18.063663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-a6c0460a-ef22-49af-9d98-7152e8e4d682 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/quotas/4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 375 time: 0.0094914 Jan 05 15:09:18.117157 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-bcfad8ac-867b-4b1f-bb72-2c38f687bf86 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0478368 Jan 05 15:09:18.215307 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-edfa5f03-b473-4d9a-8b9e-3cea1ed5d3d7 service neutron] 10.222.0.30 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862932 Jan 05 15:09:18.318989 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e4ac945-3aca-4ea7-bf01-9657e2168b2d req-77ca5ddb-328a-453b-bd87-c855a77ed466 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:18.320370 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0e4ac945-3aca-4ea7-bf01-9657e2168b2d req-77ca5ddb-328a-453b-bd87-c855a77ed466 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 1098 time: 0.0910325 Jan 05 15:09:18.348521 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-d537ed96-f34e-4025-a13e-0cc3d761e3e6 service neutron] 10.222.0.30 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1274080 Jan 05 15:09:18.372246 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0e4ac945-3aca-4ea7-bf01-9657e2168b2d req-ebcd0119-d18e-4c08-8646-12ef5cbd1b10 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449753 Jan 05 15:09:18.796860 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd req-6b2cf4bd-9772-4f3b-a9fe-9bdc86880b81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:18.798443 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd req-6b2cf4bd-9772-4f3b-a9fe-9bdc86880b81 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 945 time: 0.0478866 Jan 05 15:09:18.844876 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-0eec8315-b1d7-4664-a0da-17e13bbb9ecd req-ad9ceb8c-8d03-4041-a50b-cb04d071e832 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408912 Jan 05 15:09:18.905562 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-498530b9-5761-43f9-9288-f44c223744c1 req-39cbd41e-9894-4c28-8e4d-1c5ca82a787c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 210 time: 0.0262170 Jan 05 15:09:19.042815 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:09:19.957288 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab6e47f-bfc1-4bac-976f-1c18062be93c req-beb6d7c5-b954-41bc-a4d0-6869c595bc02 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:19.958804 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1ab6e47f-bfc1-4bac-976f-1c18062be93c req-beb6d7c5-b954-41bc-a4d0-6869c595bc02 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 945 time: 0.0487688 Jan 05 15:09:19.994712 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3fd3d139-59db-4774-85cc-befaadafdbe4 req-2c4a790b-1c76-447f-898d-7d2118101c23 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 210 time: 0.0260458 Jan 05 15:09:20.008999 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1ab6e47f-bfc1-4bac-976f-1c18062be93c req-db649476-3f06-4231-8f80-d6ef88def545 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444806 Jan 05 15:09:21.091385 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-da4853f8-c6cc-406a-968a-d97bb706a5bc req-95d7f51f-d894-486d-a480-214624b736d4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 210 time: 0.0295458 Jan 05 15:09:21.208623 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-6fece338-37ca-4577-8507-f628fbb2ccab tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:21.210040 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-6fece338-37ca-4577-8507-f628fbb2ccab tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 810 time: 0.1007915 Jan 05 15:09:21.287553 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-03855f0b-c8ec-40a8-ab55-452d8fa4e537 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 379 time: 0.0535498 Jan 05 15:09:21.296392 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'port': {'device_id': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'admin_state_up': True, 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'security_groups': ['a2c3d224-9c0a-4ff5-980a-10e9592f96c9']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:21.455772 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Made reservation on behalf of 4ed05f9412d9477ea62f75cd05af148b for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:09:21.459479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:21.583413 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Allocated IP 172.20.0.3 (b2bf0812-1bb3-4cbd-8030-193c492fed7f/4edb11eb-ca12-4d58-bf53-1c547357436d/a33e7757-b68a-479b-83e9-2b37ebb10d65) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:09:21.717029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:21.797367 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:21.838332 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:09:21.841514 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:09:21.851425 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:09:21.872880 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=a33e7757-b68a-479b-83e9-2b37ebb10d65,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:21.902432 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:21.903072 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:22.011141 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-c6266284-f9cb-4890-bd7a-ef6341f37b97 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7182305 Jan 05 15:09:22.028448 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Request body: {'port': {'device_id': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:22.072702 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-2bd7679d-e33a-4005-875b-85ddbc1ad282 None None] Provisioning complete for port a33e7757-b68a-479b-83e9-2b37ebb10d65 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:22.073343 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2bd7679d-e33a-4005-875b-85ddbc1ad282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:22.109092 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-2bd7679d-e33a-4005-875b-85ddbc1ad282 None None] Port a33e7757-b68a-479b-83e9-2b37ebb10d65 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:09:22.346661 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:22.518595 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f3e618-6891-46bd-bef2-8a0438c59df1 req-0fa8c245-c478-4855-a757-0a18f389d43b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:22.520065 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-94f3e618-6891-46bd-bef2-8a0438c59df1 req-0fa8c245-c478-4855-a757-0a18f389d43b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 931 time: 0.1860456 Jan 05 15:09:22.610536 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-94f3e618-6891-46bd-bef2-8a0438c59df1 req-ec0db67b-cd70-4603-a733-5835835025d9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669484 Jan 05 15:09:22.675038 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a33e7757-b68a-479b-83e9-2b37ebb10d65 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:09:22.682751 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:22.694742 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Transition to ACTIVE for port object a33e7757-b68a-479b-83e9-2b37ebb10d65 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:09:22.750719 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:22.801606 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Pushing event updated for resources: {'Port': ['ID=a33e7757-b68a-479b-83e9-2b37ebb10d65,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:22.871306 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Attempting to bind port a33e7757-b68a-479b-83e9-2b37ebb10d65 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:09:22.871645 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Attempting to bind port a33e7757-b68a-479b-83e9-2b37ebb10d65 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:09:22.871972 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Attempting to bind port a33e7757-b68a-479b-83e9-2b37ebb10d65 on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:09:22.877171 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Port a33e7757-b68a-479b-83e9-2b37ebb10d65 on network b2bf0812-1bb3-4cbd-8030-193c492fed7f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:09:22.877498 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Attempting to bind port a33e7757-b68a-479b-83e9-2b37ebb10d65 on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:09:22.882370 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 9, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:09:22.882706 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Checking segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:09:22.883086 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Bound using segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:09:22.883509 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Bound port: a33e7757-b68a-479b-83e9-2b37ebb10d65, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:09:22.883867 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:22.959298 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] For port a33e7757-b68a-479b-83e9-2b37ebb10d65, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:09:22.962338 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] For port a33e7757-b68a-479b-83e9-2b37ebb10d65, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:09:23.031483 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:23.063645 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.064904 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:23.066313 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] 10.222.0.13 "PUT /v2.0/ports/a33e7757-b68a-479b-83e9-2b37ebb10d65 HTTP/1.1" status: 200 len: 1093 time: 1.0419695 Jan 05 15:09:23.066750 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:09:23.068964 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8e0c6c4-5808-47c4-b985-e27efbd4db80" -d '{"events": [{"name": "network-changed", "server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:09:23.096230 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9ded7a-9257-4d97-9c2f-97c91d366bba service neutron] Pushing event updated for resources: {'Port': ['ID=a33e7757-b68a-479b-83e9-2b37ebb10d65,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:23.123797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:09:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 x-openstack-request-id: req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:09:23.123797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:09:23.123797 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-82f7d2c7-b414-4f1f-8946-2ae43a4eeb52 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:09:23.123797 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'status': 'completed', 'code': 200} Jan 05 15:09:23.204077 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-4e3eed84-cfec-49c2-86a1-d8895e35eba2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.205632 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-4e3eed84-cfec-49c2-86a1-d8895e35eba2 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 1096 time: 0.0427191 Jan 05 15:09:23.310672 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-05f57fb9-5c0d-413c-8100-2629a130136e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.312128 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-05f57fb9-5c0d-413c-8100-2629a130136e service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=4ed05f9412d9477ea62f75cd05af148b&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0930772 Jan 05 15:09:23.401287 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-6ab55ff8-fbb4-4c93-89da-94f88f8c9ea7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.402679 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c8e0c6c4-5808-47c4-b985-e27efbd4db80 req-6ab55ff8-fbb4-4c93-89da-94f88f8c9ea7 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0852239 Jan 05 15:09:23.499672 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-29d11eba-eb1b-4a63-972c-3656df5c5559 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.501192 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-29d11eba-eb1b-4a63-972c-3656df5c5559 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 1096 time: 0.0455637 Jan 05 15:09:23.546341 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-bbf85b01-6250-486d-aa44-bce4ce49a4b4 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65 HTTP/1.1" status: 200 len: 217 time: 0.0330985 Jan 05 15:09:23.590924 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-a6900bf9-e453-4395-9cc9-b1f1f799fed3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.592326 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-a6900bf9-e453-4395-9cc9-b1f1f799fed3 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0410769 Jan 05 15:09:23.638646 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-9ad5f13c-f4a1-4243-96c8-1efa84298118 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.640241 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-9ad5f13c-f4a1-4243-96c8-1efa84298118 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419374 Jan 05 15:09:23.759043 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0913eba-2048-4034-8e61-44858f29b2d7 req-b953b614-ce30-42c9-b9cb-c9d576565823 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:23.760408 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0913eba-2048-4034-8e61-44858f29b2d7 req-b953b614-ce30-42c9-b9cb-c9d576565823 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0701318 Jan 05 15:09:23.765603 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-3ad51b8f-72f1-4462-a496-3be9daaf8c6a service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1197035 Jan 05 15:09:23.862189 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-a0913eba-2048-4034-8e61-44858f29b2d7 req-2d3a3ccd-defc-4499-8144-6cfe09d227e0 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0956447 Jan 05 15:09:23.886625 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bb5f9148-824c-4be6-a9fc-8091e2c80d39 req-7f699002-7b92-490a-95b4-70cb3830f0ed service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1131978 Jan 05 15:09:25.023532 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29bcab54-fb10-41a1-968e-75ac0ed53abe req-6ec53471-cb27-4256-8514-abbc37ce2668 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:25.025001 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-29bcab54-fb10-41a1-968e-75ac0ed53abe req-6ec53471-cb27-4256-8514-abbc37ce2668 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0962982 Jan 05 15:09:25.072114 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-29bcab54-fb10-41a1-968e-75ac0ed53abe req-f4b5c96d-e24b-4c3c-acef-0a11a3bc396c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415287 Jan 05 15:09:26.185960 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b35398-039e-49cb-b7c2-b66deeca815f req-f8e7262b-46b5-4ff3-ad60-1b135cd2bedb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:26.187412 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c8b35398-039e-49cb-b7c2-b66deeca815f req-f8e7262b-46b5-4ff3-ad60-1b135cd2bedb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0497174 Jan 05 15:09:26.242334 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c8b35398-039e-49cb-b7c2-b66deeca815f req-e448b9a8-05ea-4006-b7eb-8e0e46614baf tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493417 Jan 05 15:09:27.363680 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16155127-9002-45e8-8dcf-886207562c6c req-34b588a5-3f87-476d-9389-ee90f9d7291b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:27.365106 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-16155127-9002-45e8-8dcf-886207562c6c req-34b588a5-3f87-476d-9389-ee90f9d7291b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0481949 Jan 05 15:09:27.412630 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-16155127-9002-45e8-8dcf-886207562c6c req-b548a5d4-1442-4a96-a475-f5d727e537e5 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419009 Jan 05 15:09:28.159023 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2b9ac1aa-2c12-404d-a35a-944ecad0a903 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:28.524869 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e785632-b0c3-436d-8679-c6814ea86669 req-1d2d7baf-b108-4568-8a47-c5f10addc2b2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:28.526369 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3e785632-b0c3-436d-8679-c6814ea86669 req-1d2d7baf-b108-4568-8a47-c5f10addc2b2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0494215 Jan 05 15:09:28.575641 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3e785632-b0c3-436d-8679-c6814ea86669 req-18d8cd78-287e-457c-9c43-9217c65cd113 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436652 Jan 05 15:09:29.689650 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eba42c6-9064-4efe-b0ab-d8490cd13711 req-d6a72513-517b-4613-b743-ee946074f8e2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:29.691675 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3eba42c6-9064-4efe-b0ab-d8490cd13711 req-d6a72513-517b-4613-b743-ee946074f8e2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0516703 Jan 05 15:09:29.739424 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3eba42c6-9064-4efe-b0ab-d8490cd13711 req-95c8972a-fc06-4187-943b-b7b4a69f3611 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422843 Jan 05 15:09:30.404642 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6b04c908-8505-4b24-a672-8a7943be47eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:30.852210 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 req-789cee0d-c9d4-4932-8a98-6dde823fa4a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:30.853763 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 req-789cee0d-c9d4-4932-8a98-6dde823fa4a9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0500281 Jan 05 15:09:30.901834 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-bc56b5ba-e875-4c57-8c76-3f36a37cf468 req-eed15668-76f7-404b-b7dd-8f9e780cb316 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424592 Jan 05 15:09:31.832993 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:32.012980 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c0032af-fd18-4deb-a88b-97c0a8744570 req-112b0f14-5e6e-4e13-a0b1-6f12b331e48a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:32.014465 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8c0032af-fd18-4deb-a88b-97c0a8744570 req-112b0f14-5e6e-4e13-a0b1-6f12b331e48a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0480189 Jan 05 15:09:32.064800 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8c0032af-fd18-4deb-a88b-97c0a8744570 req-ec591be2-ae0d-4546-9cd4-74c216a8b21e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446093 Jan 05 15:09:32.750917 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:33.181287 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d req-d0f6ed09-14ef-4d36-9a38-4a6f3f72d136 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:33.182730 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d req-d0f6ed09-14ef-4d36-9a38-4a6f3f72d136 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0525455 Jan 05 15:09:33.232428 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2f1200bc-67d0-4d09-9df8-b431e8d38f1d req-9ece5da9-e38a-4c90-b392-15777f05e8b6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440547 Jan 05 15:09:33.644225 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:34.343169 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 req-7cec8725-8ea1-4cd2-868f-7c97ca5e3bc3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:34.344566 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 req-7cec8725-8ea1-4cd2-868f-7c97ca5e3bc3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0466013 Jan 05 15:09:34.395924 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-603a19e0-8e00-44dd-8a64-fcc8f1cc9d89 req-0df833ca-239d-4b9b-a53d-6b9f7ffe29ac tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449493 Jan 05 15:09:34.410761 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:35.508761 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4030ad22-33ec-4a56-b479-931abecd457b req-40412a01-e034-4ab8-b8ae-ee2c5bbaabfc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:35.510322 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4030ad22-33ec-4a56-b479-931abecd457b req-40412a01-e034-4ab8-b8ae-ee2c5bbaabfc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0486152 Jan 05 15:09:35.558650 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4030ad22-33ec-4a56-b479-931abecd457b req-9753f635-7fa5-4529-bb5d-020c76ef6778 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428367 Jan 05 15:09:36.669358 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6026743c-867f-4a69-857d-1982bdf8797e req-dc529ba5-057d-43e5-9c49-e3bfb44d6478 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:36.670835 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6026743c-867f-4a69-857d-1982bdf8797e req-dc529ba5-057d-43e5-9c49-e3bfb44d6478 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0476229 Jan 05 15:09:36.717419 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6026743c-867f-4a69-857d-1982bdf8797e req-2adf4da9-2f75-4bdb-a50c-6ba7da7c12ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406184 Jan 05 15:09:37.829268 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 req-2836b3ba-5579-4168-b0c2-42138f07beea tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:37.830774 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 req-2836b3ba-5579-4168-b0c2-42138f07beea tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0485909 Jan 05 15:09:37.882704 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c7ee317e-56d7-4c4d-8268-3fa694e857b5 req-22b2d15a-39a6-44f8-8ed4-6087270be1e2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462751 Jan 05 15:09:38.993731 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 req-b07f9f06-3fd0-4d85-a821-406d6dc52b4f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:38.995188 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 req-b07f9f06-3fd0-4d85-a821-406d6dc52b4f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 943 time: 0.0482168 Jan 05 15:09:39.042476 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b11f36cd-11e3-498e-b6aa-e221a75b2fc5 req-08a8de31-05bb-4ebf-910a-b366d1264974 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418849 Jan 05 15:09:39.793662 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a33e7757-b68a-479b-83e9-2b37ebb10d65 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:09:39.889379 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port a33e7757-b68a-479b-83e9-2b37ebb10d65, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:39.901263 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'port_id': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'mac_address': 'fa:16:3e:86:38:57', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 128, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:09:39.936626 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:39.949239 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a33e7757-b68a-479b-83e9-2b37ebb10d65 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:09:39.968627 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port a33e7757-b68a-479b-83e9-2b37ebb10d65, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:40.044281 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:40.094234 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=a33e7757-b68a-479b-83e9-2b37ebb10d65,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:40.166910 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-592a87ec-10c7-4bdf-9542-f83bd0dbfa76 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0763876 Jan 05 15:09:40.178945 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec0f95a-8695-4b05-b046-3f05080cb310 req-0f5a994c-4e5b-42b0-845b-1add5b8913dc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:40.180314 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7ec0f95a-8695-4b05-b046-3f05080cb310 req-0f5a994c-4e5b-42b0-845b-1add5b8913dc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 944 time: 0.0586638 Jan 05 15:09:40.230394 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7ec0f95a-8695-4b05-b046-3f05080cb310 req-0bd522b1-6727-401f-9dc3-86205966afbc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444837 Jan 05 15:09:40.274565 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-513fc88d-5abd-4ddf-8f16-c7abd759348d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:40.276021 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-513fc88d-5abd-4ddf-8f16-c7abd759348d service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 1098 time: 0.0436153 Jan 05 15:09:40.345380 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['a33e7757-b68a-479b-83e9-2b37ebb10d65'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:09:40.375334 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-7eee370e-418e-4756-80ed-483893e17c1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:40.376787 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-7eee370e-418e-4756-80ed-483893e17c1a service neutron] 10.222.0.13 "GET /v2.0/networks?id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a HTTP/1.1" status: 200 len: 915 time: 0.0820351 Jan 05 15:09:40.416819 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-8e7fe372-846d-4075-aad2-27d81e7dd92a service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=538500aa-927f-4d3d-978d-d6e32e769918 HTTP/1.1" status: 200 len: 217 time: 0.0340457 Jan 05 15:09:40.466309 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-b3ef7960-97d4-4d3a-a2cb-967043924183 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:40.467743 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-b3ef7960-97d4-4d3a-a2cb-967043924183 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=d2a43a22-37fb-4c9b-bcbe-1e4cb1759710 HTTP/1.1" status: 200 len: 854 time: 0.0456409 Jan 05 15:09:40.499778 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-224bf228-1049-430a-83d5-31b1990ffa8f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253785 Jan 05 15:09:40.510025 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-8f0d6b9a-2ea0-4d7e-8bac-321d75f3dafd service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 15:09:40.510985 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-8f0d6b9a-2ea0-4d7e-8bac-321d75f3dafd service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049958 Jan 05 15:09:40.596416 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-2280c882-920f-422a-b835-f42334aaf793 service neutron] 10.222.0.13 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795038 Jan 05 15:09:40.686346 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-339853c2-b498-4dcf-9a51-46d17b5bbb55 req-0c96b3a5-0daa-4090-9186-5ab63fda0ba6 service neutron] 10.222.0.13 "GET /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844712 Jan 05 15:09:41.342162 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3822ac1-a604-423f-8dc3-8ff73a5885ef req-fff4cdc5-4976-4815-b330-19e7151a44fc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:41.343645 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f3822ac1-a604-423f-8dc3-8ff73a5885ef req-fff4cdc5-4976-4815-b330-19e7151a44fc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 944 time: 0.0481722 Jan 05 15:09:41.392822 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-f3822ac1-a604-423f-8dc3-8ff73a5885ef req-32c7e331-f5f1-4447-9c0a-ad384a173708 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432613 Jan 05 15:09:41.817308 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a33e7757-b68a-479b-83e9-2b37ebb10d65 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:09:41.953096 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port a33e7757-b68a-479b-83e9-2b37ebb10d65 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:09:41.957127 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port a33e7757-b68a-479b-83e9-2b37ebb10d65 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:09:41.957504 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:42.035647 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:42.060781 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:09:42.063065 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-425d01d0-4bd8-4182-b125-3533479911c5" -d '{"events": [{"server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "name": "network-vif-plugged", "status": "completed", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:09:42.076131 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port a33e7757-b68a-479b-83e9-2b37ebb10d65, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:42.103367 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:09:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 x-openstack-request-id: req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:09:42.103665 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "name": "network-vif-plugged", "status": "completed", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:09:42.103921 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-20db0dae-90db-425c-9fa5-bfcc62b1e1e8 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:09:42.104315 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'code': 200} Jan 05 15:09:42.164996 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:42.216788 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=a33e7757-b68a-479b-83e9-2b37ebb10d65,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:42.419397 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37f4e66-6afe-4dbd-ab2f-abe344e1cd3e req-cca3e0eb-02a4-4fc5-8723-abaf876e837b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:42.420946 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37f4e66-6afe-4dbd-ab2f-abe344e1cd3e req-cca3e0eb-02a4-4fc5-8723-abaf876e837b service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 1098 time: 0.0440521 Jan 05 15:09:42.467293 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37f4e66-6afe-4dbd-ab2f-abe344e1cd3e req-dc01c10a-6156-40af-b375-94c7b834e82f service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396171 Jan 05 15:09:42.509305 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1779ed7e-6105-416e-8346-bb5264fd6e48 req-85988f3f-cb1b-4069-bcb2-c45c87e8d210 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:42.510783 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1779ed7e-6105-416e-8346-bb5264fd6e48 req-85988f3f-cb1b-4069-bcb2-c45c87e8d210 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 945 time: 0.0518117 Jan 05 15:09:42.559041 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1779ed7e-6105-416e-8346-bb5264fd6e48 req-ad070f74-7b7b-450a-acee-d1c2c5b322ce tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423543 Jan 05 15:09:42.660479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d58d5b-fa1b-4520-96fc-424811f03d81 req-1280956e-6f9f-4946-a56b-20a7881da40b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:42.661987 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c5d58d5b-fa1b-4520-96fc-424811f03d81 req-1280956e-6f9f-4946-a56b-20a7881da40b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 945 time: 0.0499086 Jan 05 15:09:42.708778 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c5d58d5b-fa1b-4520-96fc-424811f03d81 req-27c6067a-1ed3-475c-a7a3-7077ed06ae58 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412157 Jan 05 15:09:43.672350 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b689634-a6de-4a9e-a79a-94e4c5875921 req-33ea2464-4c24-4555-944b-7cb82d68777f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:43.673746 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6b689634-a6de-4a9e-a79a-94e4c5875921 req-33ea2464-4c24-4555-944b-7cb82d68777f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 945 time: 0.0475342 Jan 05 15:09:43.720752 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-6b689634-a6de-4a9e-a79a-94e4c5875921 req-7f6cdf20-321b-4ea7-aeda-00eaf76433d6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407953 Jan 05 15:09:43.824294 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 req-7b2d1940-2ccb-4464-b424-327bff497faa tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:43.825793 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 req-7b2d1940-2ccb-4464-b424-327bff497faa tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 945 time: 0.0478964 Jan 05 15:09:43.876225 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b0c81dc7-2153-425e-a5c0-5cf4b1ad7803 req-8aa87ebf-74f0-4520-949e-2e605971ca9c tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447781 Jan 05 15:09:44.807913 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-f29e6bb1-6a70-4dc2-8164-12ecac72cc20 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:44.809345 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-f29e6bb1-6a70-4dc2-8164-12ecac72cc20 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 945 time: 0.0483477 Jan 05 15:09:44.838246 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b25623-de28-4ccb-a7ce-ba3cef792bae req-f4b0a500-d9c8-40cf-a270-c11c19f14407 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:44.839720 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-70b25623-de28-4ccb-a7ce-ba3cef792bae req-f4b0a500-d9c8-40cf-a270-c11c19f14407 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 945 time: 0.0520914 Jan 05 15:09:44.898957 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-70b25623-de28-4ccb-a7ce-ba3cef792bae req-4f063c63-124f-43be-88d9-c27a45fd41c0 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0505066 Jan 05 15:09:44.903192 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Deleting port 538500aa-927f-4d3d-978d-d6e32e769918 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:09:44.903682 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.012715 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 req-f28aa9d4-ba11-4355-9287-5e44ded3a04b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:45.014231 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 req-f28aa9d4-ba11-4355-9287-5e44ded3a04b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 945 time: 0.0483479 Jan 05 15:09:45.028002 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e412d9c-0476-4b6e-8321-0ddedff78e2c req-d3b520a0-0874-4b72-b420-7e0f0a33b47b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:45.029471 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3e412d9c-0476-4b6e-8321-0ddedff78e2c req-d3b520a0-0874-4b72-b420-7e0f0a33b47b tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 945 time: 0.0771315 Jan 05 15:09:45.034279 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] For port 538500aa-927f-4d3d-978d-d6e32e769918, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=538500aa-927f-4d3d-978d-d6e32e769918,segment=NetworkSegment(eecb354a-4972-44ae-a5e5-e5fe7673ae43),segment_id=eecb354a-4972-44ae-a5e5-e5fe7673ae43)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:09:45.034634 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.060748 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Calling delete_port for 538500aa-927f-4d3d-978d-d6e32e769918 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:09:45.062954 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-49777fb2-6387-4ce7-98ae-08f4bbf4ffb4 req-e84edb1c-a985-43fc-a8fc-6d2443e6b2b6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429811 Jan 05 15:09:45.084703 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52238) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:09:45.130551 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-3e412d9c-0476-4b6e-8321-0ddedff78e2c req-e2df1bea-888f-4e34-ba83-49caa201ca84 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/security-groups?id=5c337bf7-06ff-460a-86cf-ed845b54b3a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928166 Jan 05 15:09:45.166808 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed66580a-aa5b-46f6-b98e-87328457e073 tempest-TestVolumeBootPattern-1804168086 tempest-TestVolumeBootPattern-1804168086-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:45.168330 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-ed66580a-aa5b-46f6-b98e-87328457e073 tempest-TestVolumeBootPattern-1804168086 tempest-TestVolumeBootPattern-1804168086-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 1093 time: 0.0826094 Jan 05 15:09:45.171310 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52242) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:09:45.176145 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'port_id': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address': '172.20.0.3'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:09:45.282211 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.311140 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.346326 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['538500aa-927f-4d3d-978d-d6e32e769918'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:09:45.346920 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Pushing event deleted for resources: {'Port': ['ID=538500aa-927f-4d3d-978d-d6e32e769918,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:45.384127 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.385517 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] No DVR routers for this DVR port 538500aa-927f-4d3d-978d-d6e32e769918 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:09:45.387917 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.391231 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2c5c1a60-4e26-467e-a060-8e691f74eb27 req-e34679d6-b732-4b3a-b7a7-8938435c7873 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.13 "DELETE /v2.0/ports/538500aa-927f-4d3d-978d-d6e32e769918 HTTP/1.1" status: 204 len: 173 time: 0.5772152 Jan 05 15:09:45.391674 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19df41f2-6b98-48a5-8198-d80388e39e73', 'name': 'network-vif-deleted', 'tag': '538500aa-927f-4d3d-978d-d6e32e769918'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:09:45.394613 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36b59fea-ff0c-4e08-805d-6adb31dca6d6" -d '{"events": [{"server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "name": "network-vif-deleted", "tag": "538500aa-927f-4d3d-978d-d6e32e769918"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:09:45.431480 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:09:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a x-openstack-request-id: req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:09:45.431780 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19df41f2-6b98-48a5-8198-d80388e39e73", "name": "network-vif-deleted", "tag": "538500aa-927f-4d3d-978d-d6e32e769918", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:09:45.432035 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7e8d48db-e95f-486f-aa90-a2a1c6ad8d2a {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:09:45.432445 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '19df41f2-6b98-48a5-8198-d80388e39e73', 'name': 'network-vif-deleted', 'tag': '538500aa-927f-4d3d-978d-d6e32e769918', 'status': 'completed', 'code': 200} Jan 05 15:09:45.492472 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Allocated IP 172.37.2.19 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/1d5a6bb2-0728-4f8c-b715-f56fd1ac8625) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:09:45.592134 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.718692 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:45.753987 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:09:45.756708 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:09:45.760241 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:09:45.789707 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=1d5a6bb2-0728-4f8c-b715-f56fd1ac8625,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:46.106712 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:46.232894 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-aa788907-0cd3-4b51-b8bc-4f372b9e1347 req-4b1b0c39-3441-4b6a-8ae2-c0c5038ca553 tempest-VolumesSnapshotTestJSON-618820265 tempest-VolumesSnapshotTestJSON-618820265-project] 10.222.0.30 "GET /v2.0/ports?device_id=19df41f2-6b98-48a5-8198-d80388e39e73 HTTP/1.1" status: 200 len: 210 time: 0.0254588 Jan 05 15:09:46.278711 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:46.422256 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:46.518246 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:46.589226 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=1d5a6bb2-0728-4f8c-b715-f56fd1ac8625,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:09:46.599122 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:46.695132 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Floating IP f019abae-0b32-4a7c-84ce-6821087fe812 associated. External IP: 172.37.2.19, port: a33e7757-b68a-479b-83e9-2b37ebb10d65. Jan 05 15:09:46.903474 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:09:47.014382 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:09:47.022773 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:09:47.032054 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:09:47.032656 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:09:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:09:47.095567 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:09:47.122250 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-7f9a14d2-e274-46d5-8132-39d029a8c82b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.9499438 Jan 05 15:09:47.122940 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:09:47.125059 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e" -d '{"events": [{"name": "network-changed", "server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:09:47.137685 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:09:47.175880 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:09:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33bc5f82-5154-460f-9862-47496883c9ad x-openstack-request-id: req-33bc5f82-5154-460f-9862-47496883c9ad {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:09:47.176168 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:09:47.176925 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-33bc5f82-5154-460f-9862-47496883c9ad {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:09:47.176925 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'status': 'completed', 'code': 200} Jan 05 15:09:47.257223 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-577d5369-c1d9-46c8-b23a-c0fef5371dbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:47.258710 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-577d5369-c1d9-46c8-b23a-c0fef5371dbe service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 1098 time: 0.0401886 Jan 05 15:09:47.362815 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-a642b8fc-ebbd-487d-af48-8271236bbf2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:47.364380 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-a642b8fc-ebbd-487d-af48-8271236bbf2d service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0991049 Jan 05 15:09:47.366398 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'f019abae-0b32-4a7c-84ce-6821087fe812', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.19', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:86:38:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:09:45Z', 'updated_at': '2022-01-05T15:09:45Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:09:47.397811 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:09:47.406239 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:09:47.406848 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:09:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:09:47.433396 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-7768c1a5-b0d4-452a-9b88-9059ccaafd5c service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65 HTTP/1.1" status: 200 len: 998 time: 0.0630465 Jan 05 15:09:47.483760 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-b4f6de5e-a976-4611-9f5a-6510539efa2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:47.485275 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-b4f6de5e-a976-4611-9f5a-6510539efa2f service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0465376 Jan 05 15:09:47.537506 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-507bc7a5-5d70-4a48-bbe7-69009f301b49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:09:47.539186 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-507bc7a5-5d70-4a48-bbe7-69009f301b49 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0485163 Jan 05 15:09:47.636154 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-c179b019-c9e3-4269-a17b-0a6ad771458c service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902662 Jan 05 15:09:47.643938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:09:47.732705 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c82dddc6-d53b-4b6e-aa6e-b4099246ec0e req-3a2ce0b6-dfa5-49fc-aaab-7eefbbd76586 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901964 Jan 05 15:09:47.876235 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'f019abae-0b32-4a7c-84ce-6821087fe812', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.19', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:86:38:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:09:45Z', 'updated_at': '2022-01-05T15:09:45Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:09:47.907388 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7757015a-5fb2-457c-b0f7-90243d6000cc None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'f019abae-0b32-4a7c-84ce-6821087fe812', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.19', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:86:38:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:09:45Z', 'updated_at': '2022-01-05T15:09:45Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:09:48.101016 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1e8ad2c-7062-4e5c-8e67-139281b2a520 None None] New status for floating IP f019abae-0b32-4a7c-84ce-6821087fe812: ACTIVE {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:09:51.244707 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 538500aa-927f-4d3d-978d-d6e32e769918 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:09:51.264570 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 538500aa-927f-4d3d-978d-d6e32e769918 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:09:51.264914 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 538500aa-927f-4d3d-978d-d6e32e769918 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:09:56.045501 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:09:58.219500 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fc7b508c-d7cf-4c79-b4db-a68debdde531 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:00.384517 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-39a33a55-4c70-4d31-ab25-d5c2d35aba86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:01.841806 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:02.744673 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:03.638177 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:04.409276 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:12.956751 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52388) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:10:12.999640 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Deleting subnet d2a43a22-37fb-4c9b-bcbe-1e4cb1759710 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:10:13.002581 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.034697 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.071119 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.470270 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.493513 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d2a43a22-37fb-4c9b-bcbe-1e4cb1759710,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:10:13.503924 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.507087 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/d2a43a22-37fb-4c9b-bcbe-1e4cb1759710 HTTP/1.1" status: 204 len: 168 time: 0.5493145 Jan 05 15:10:13.509029 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.509500 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.509846 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.509984 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 52390) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:10:13.510395 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.510485 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.510809 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.511541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.511541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.511741 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.512085 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.512402 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.512715 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.513028 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b6ba9-dcb8-4fba-ad80-0b17a77d61b6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.576704 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.655807 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.675639 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a']}} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:10:13.684486 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eecb354a-4972-44ae-a5e5-e5fe7673ae43') {'for_net_delete': True} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:10:13.684786 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.services.segments.db [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eecb354a-4972-44ae-a5e5-e5fe7673ae43') {} {{(pid=114654) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:10:13.693793 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8770643'] for segment, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.706410 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.712183 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Releasing vlan 107 on physical network physnet1 to pool {{(pid=114654) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8859463'] for segment, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.718605 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: warnings.warn(msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: Traceback (most recent call last): Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: timer() Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: cb(*args, **kw) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: return func(*args, **kwargs) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: self._notify() Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: self.callback(batched_events) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: event.method(event) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: return f(self, *a, **k) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: return self._get(url).json() Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: return self.request(url, 'GET', **kwargs) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:10:13.721216 dv-cinder-master-3-iscsi neutron-server[114654]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:10:13.875918 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.881570 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:13.884692 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] 10.222.0.30 "DELETE /v2.0/networks/4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a HTTP/1.1" status: 204 len: 168 time: 0.3737199 Jan 05 15:10:13.896108 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Pushing event deleted for resources: {'Network': ['ID=4f36140d-d4a8-4b9a-8dbb-7e8c92be1c3a,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:10:13.903138 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.903485 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.903829 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.904738 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.905091 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.905452 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.905763 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.906091 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.906420 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.906750 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.907073 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.907393 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:13.907711 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd699c6d-fc4d-4067-affd-43860d021847 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:10:14.303933 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 52394) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:10:14.345000 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-aa8a40fe-dfd6-48ce-b046-269a7cdd36b5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4ffa8c6fb14941c6ba03ddd2d63c49be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0399184 Jan 05 15:10:14.347362 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 52398) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:10:14.399604 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-458f8288-1ae1-4e8e-bc6b-dd42a4ea06f0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:14.420158 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-458f8288-1ae1-4e8e-bc6b-dd42a4ea06f0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:14.550146 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-458f8288-1ae1-4e8e-bc6b-dd42a4ea06f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:14.552771 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-458f8288-1ae1-4e8e-bc6b-dd42a4ea06f0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:14.553947 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-458f8288-1ae1-4e8e-bc6b-dd42a4ea06f0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5c337bf7-06ff-460a-86cf-ed845b54b3a9 HTTP/1.1" status: 204 len: 168 time: 0.2057142 Jan 05 15:10:14.562632 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-458f8288-1ae1-4e8e-bc6b-dd42a4ea06f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c337bf7-06ff-460a-86cf-ed845b54b3a9,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:10:25.082787 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 52474) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:10:25.184339 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f22e370e-153e-4a45-9761-61fe8352ce48 admin admin] Publish callbacks [] for security_group, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:25.256556 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f22e370e-153e-4a45-9761-61fe8352ce48 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:25.344292 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-f22e370e-153e-4a45-9761-61fe8352ce48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:25.382761 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-f22e370e-153e-4a45-9761-61fe8352ce48 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b48bec9ebb5c482993c33471f3d92a6b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2989225 Jan 05 15:10:25.383637 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f22e370e-153e-4a45-9761-61fe8352ce48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=485fd11c-a6bb-48c5-a02b-c3607c6829ed,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:10:25.385538 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52478) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:10:25.433138 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-60d778e8-c15d-4fc8-880c-8b39ae5e4e1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:25.452897 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-60d778e8-c15d-4fc8-880c-8b39ae5e4e1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:25.555532 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-60d778e8-c15d-4fc8-880c-8b39ae5e4e1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:25.558143 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-60d778e8-c15d-4fc8-880c-8b39ae5e4e1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:25.559300 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-60d778e8-c15d-4fc8-880c-8b39ae5e4e1e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/485fd11c-a6bb-48c5-a02b-c3607c6829ed HTTP/1.1" status: 204 len: 168 time: 0.1727688 Jan 05 15:10:25.567241 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d778e8-c15d-4fc8-880c-8b39ae5e4e1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=485fd11c-a6bb-48c5-a02b-c3607c6829ed,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:10:28.189402 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5ad6537b-44fe-4cbf-8149-68d161c4888a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:30.368729 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e587047d-81bf-4d0a-bd7b-f641d7df02ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:31.875856 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:32.888973 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:33.044231 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:10:33.648952 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:34.397175 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:10:40.966110 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-b787a1a2-22bd-44e0-a941-08fd4e5109f4 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1256979 Jan 05 15:10:41.059882 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0588884d-d705-4c9a-a7df-6776252bef8b req-9f1d0dac-fb01-4ed3-bd3e-5181d90e6a47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:10:41.061354 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-9f1d0dac-fb01-4ed3-bd3e-5181d90e6a47 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 1098 time: 0.0382264 Jan 05 15:10:41.159544 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0588884d-d705-4c9a-a7df-6776252bef8b req-748a705e-0470-49b6-a801-0acd5bf9250a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:10:41.160985 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-748a705e-0470-49b6-a801-0acd5bf9250a service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0821064 Jan 05 15:10:41.226209 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-41cfddaf-5d07-4f8b-8950-737dcbda9b74 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65 HTTP/1.1" status: 200 len: 1000 time: 0.0596559 Jan 05 15:10:41.270895 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0588884d-d705-4c9a-a7df-6776252bef8b req-d2167017-a8d3-4639-a03a-cd210cde7971 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:10:41.272249 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-d2167017-a8d3-4639-a03a-cd210cde7971 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0408950 Jan 05 15:10:41.313791 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0588884d-d705-4c9a-a7df-6776252bef8b req-f89d9d13-26c8-4459-8481-20c02def25bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:10:41.315230 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-f89d9d13-26c8-4459-8481-20c02def25bf service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0377629 Jan 05 15:10:41.403746 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-18e0c3b9-a75e-4e27-845f-8778e51aefc6 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817118 Jan 05 15:10:41.488751 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0588884d-d705-4c9a-a7df-6776252bef8b req-10b05fb0-fd41-40a9-8934-04a091c61cc8 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0784867 Jan 05 15:10:58.162005 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a080a35b-812b-4ed4-8a92-8c026fbaf59b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:00.423940 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-92f3a2ad-8be8-46ab-831d-2ebe497484c7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:01.870961 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:02.762057 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:03.651686 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:04.388654 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:10.043716 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:11:28.165943 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0274a22d-df57-4481-a8e1-6ea1ffbd3d9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:30.387982 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b0f2cac4-3554-4864-a661-bd9283a0e6e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:31.930769 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:32.811275 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:33.647086 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:34.408458 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:40.913457 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-ce57cc51-c35e-4bc1-95e0-1849b3d027ab service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0423286 Jan 05 15:11:41.005316 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75df42df-a2e2-4ede-84d9-1de308732248 req-98004f24-99f3-4405-9c2c-88c5e73bffdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:41.006767 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-98004f24-99f3-4405-9c2c-88c5e73bffdb service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 1098 time: 0.0395176 Jan 05 15:11:41.104003 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75df42df-a2e2-4ede-84d9-1de308732248 req-ab2aa348-8a69-4aec-802f-03e357db8eb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:41.105441 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-ab2aa348-8a69-4aec-802f-03e357db8eb8 service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0797560 Jan 05 15:11:41.174936 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-4bfdc419-c6f7-4b39-921a-02ed2d9f8106 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65 HTTP/1.1" status: 200 len: 1000 time: 0.0596282 Jan 05 15:11:41.220691 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75df42df-a2e2-4ede-84d9-1de308732248 req-2a31f0c2-0261-4897-acb4-30244f09e1e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:41.222176 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-2a31f0c2-0261-4897-acb4-30244f09e1e3 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0415235 Jan 05 15:11:41.265807 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75df42df-a2e2-4ede-84d9-1de308732248 req-61524adb-ecb8-44c7-a720-7d667779393d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:41.267237 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-61524adb-ecb8-44c7-a720-7d667779393d service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0384614 Jan 05 15:11:41.354798 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-79f5ad1d-e2fa-4aa7-ada7-2188a52ea25d service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813086 Jan 05 15:11:41.440065 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-75df42df-a2e2-4ede-84d9-1de308732248 req-d0bf3adc-9385-48d4-ac25-e3229efea84c service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788760 Jan 05 15:11:42.930012 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 req-7d026636-f87b-4239-be32-1155f6dc22ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:42.931470 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 req-7d026636-f87b-4239-be32-1155f6dc22ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 945 time: 0.0525200 Jan 05 15:11:42.979528 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-506a0a8e-9ce4-499d-95ad-b06d0797bed6 req-1f3d48d3-e2d3-494e-b557-919ea7c7f5ac tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421908 Jan 05 15:11:44.096727 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 req-83e654c8-5d2b-46bb-8439-eba80d2f80d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:44.098475 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 req-83e654c8-5d2b-46bb-8439-eba80d2f80d7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 945 time: 0.0514629 Jan 05 15:11:44.146764 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7ab1803f-310c-4378-ba7b-735fc7dc8ad7 req-5d3d1c3e-bfcf-4a8f-97ff-f93c20828e6d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428438 Jan 05 15:11:44.611616 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-5e442d29-3658-49db-988c-e6cbf1bc17ea tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:44.613085 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-5e442d29-3658-49db-988c-e6cbf1bc17ea tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 945 time: 0.0495563 Jan 05 15:11:44.700641 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Deleting port a33e7757-b68a-479b-83e9-2b37ebb10d65 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:11:44.700979 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:44.785112 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] For port a33e7757-b68a-479b-83e9-2b37ebb10d65, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a33e7757-b68a-479b-83e9-2b37ebb10d65,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:11:44.785400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:44.949884 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:44.950250 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:44.950572 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.db.l3_db [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Floating IP f019abae-0b32-4a7c-84ce-6821087fe812 disassociated. External IP: 172.37.2.19, port: a33e7757-b68a-479b-83e9-2b37ebb10d65. Jan 05 15:11:44.950913 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling delete_port for a33e7757-b68a-479b-83e9-2b37ebb10d65 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:11:45.136828 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:45.177275 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event deleted for resources: {'Port': ['ID=a33e7757-b68a-479b-83e9-2b37ebb10d65,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:11:45.191366 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.191722 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.192076 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.192420 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.192757 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.193146 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.193485 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.193818 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.194150 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.194479 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.194899 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.195121 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.195489 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:11:45.270508 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c0bd8d96-6143-41e8-9a8c-93e290d2b6f2 req-a60c19a9-04a4-4b75-90fb-4945610b4d3b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 210 time: 0.0302761 Jan 05 15:11:45.330314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:11:45.437874 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:11:45.445376 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:11:45.454736 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:11:45.455437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:11:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:11:45.478032 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] No DVR routers for this DVR port a33e7757-b68a-479b-83e9-2b37ebb10d65 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:11:45.480537 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:45.483835 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-0bf06a66-6122-4ca5-ba84-eeae1176b050 req-66947ce7-5c36-48ba-9314-62338fd16f57 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "DELETE /v2.0/ports/a33e7757-b68a-479b-83e9-2b37ebb10d65 HTTP/1.1" status: 204 len: 173 time: 0.8652232 Jan 05 15:11:45.484276 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'name': 'network-vif-deleted', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:11:45.487263 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-285a7a37-8128-4e34-b0b8-181d133ffb45" -d '{"events": [{"server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "name": "network-vif-deleted", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:11:45.581639 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:11:45.734451 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:11:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c34ffea-3c41-4309-b101-9c82719c6611 x-openstack-request-id: req-5c34ffea-3c41-4309-b101-9c82719c6611 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:11:45.734949 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f6d3cac-1745-4d46-ba6c-7342079f99b8", "name": "network-vif-deleted", "tag": "a33e7757-b68a-479b-83e9-2b37ebb10d65", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:11:45.735071 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-5c34ffea-3c41-4309-b101-9c82719c6611 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:11:45.735411 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f6d3cac-1745-4d46-ba6c-7342079f99b8', 'name': 'network-vif-deleted', 'tag': 'a33e7757-b68a-479b-83e9-2b37ebb10d65', 'status': 'completed', 'code': 200} Jan 05 15:11:45.794349 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:11:45.827540 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:11:45.836448 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:11:45.837054 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:11:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:11:45.940752 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:11:46.136372 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:11:46.163271 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a5e8176-95e1-4f0e-9958-3b19225c55f7 None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:11:46.377212 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7b3b20c1-4468-4b91-868c-7982842577f3 req-1b362db7-d5a1-40fa-8503-d14d07e71cdf tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=7f6d3cac-1745-4d46-ba6c-7342079f99b8 HTTP/1.1" status: 200 len: 210 time: 0.0267677 Jan 05 15:11:46.388651 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd304252-1d84-441f-83eb-d5e1e26da2fd None None] New status for floating IP f019abae-0b32-4a7c-84ce-6821087fe812: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:11:47.042284 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:11:47.640211 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c00db38-ae06-4210-8ed7-e6d9044a2a45 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-369949876&fields=id&tenant_id=4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 267 time: 0.0429029 Jan 05 15:11:47.748116 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-b61e7b04-e2c4-46a2-a166-421aff11c0f9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:47.749590 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-b61e7b04-e2c4-46a2-a166-421aff11c0f9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 810 time: 0.1031764 Jan 05 15:11:47.765369 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-bc95c57f-d299-4716-aa2d-63c6940bfae3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/quotas/4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 375 time: 0.0101986 Jan 05 15:11:48.070563 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-c1697bac-09c9-40f3-966b-1047a450ac37 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2987406 Jan 05 15:11:48.163001 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-9b59b1e0-2815-408d-b00f-80df27746a9b service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=114654) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jan 05 15:11:48.163986 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-9b59b1e0-2815-408d-b00f-80df27746a9b service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0819173 Jan 05 15:11:48.249752 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-18b90bca-1bef-4997-b1c4-2a9aef15d4d2 service neutron] 10.222.0.30 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789263 Jan 05 15:11:48.338047 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-bfbf34c2-33f7-4d18-b042-8a9f0053d83e service neutron] 10.222.0.30 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826707 Jan 05 15:11:48.771881 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a33e7757-b68a-479b-83e9-2b37ebb10d65 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:11:48.800903 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: a33e7757-b68a-479b-83e9-2b37ebb10d65 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:11:48.801289 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device a33e7757-b68a-479b-83e9-2b37ebb10d65 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:11:48.962641 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-3c0422bd-a660-48c1-ad66-3ca14b20e8d3 req-95449610-8ac4-42e0-a13b-9e7db4d17d68 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 210 time: 0.0257399 Jan 05 15:11:50.060202 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4f104cbb-1456-49c8-bfb4-a17ca5fb7bf1 req-8a355905-0c11-4cb9-9161-e75d48d629cc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 210 time: 0.0313845 Jan 05 15:11:50.985168 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-04744576-9360-42ab-ab78-9603e3bb7a5f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:50.986658 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-04744576-9360-42ab-ab78-9603e3bb7a5f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 810 time: 0.1026938 Jan 05 15:11:51.054477 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-d655089d-dacf-45ea-8024-f934e186cf88 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 379 time: 0.0536869 Jan 05 15:11:51.062282 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'port': {'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'admin_state_up': True, 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'security_groups': ['a2c3d224-9c0a-4ff5-980a-10e9592f96c9']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:11:51.156981 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-1164577a-3bec-4cbe-a6a3-f05a53f92747 req-a40c4f67-8d7c-468c-813e-dcccb0bc15de tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 210 time: 0.0251288 Jan 05 15:11:51.247055 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Made reservation on behalf of 4ed05f9412d9477ea62f75cd05af148b for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:11:51.250774 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:51.373709 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Allocated IP 172.20.0.8 (b2bf0812-1bb3-4cbd-8030-193c492fed7f/4edb11eb-ca12-4d58-bf53-1c547357436d/5fd3adff-46db-4f6c-976b-1c61edeb54cb) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:11:51.508959 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:51.607400 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:51.648853 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:11:51.652082 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:11:51.655598 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:11:51.663822 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=5fd3adff-46db-4f6c-976b-1c61edeb54cb,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:11:51.714907 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:51.715519 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:51.821046 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-0c06bb77-5adb-431a-877e-a6ff55b76aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7622824 Jan 05 15:11:51.837356 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Request body: {'port': {'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:11:51.892718 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:51.922761 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-22c6ca6e-2f79-4cf5-bf3c-0ef434a90a38 None None] Provisioning complete for port 5fd3adff-46db-4f6c-976b-1c61edeb54cb triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:11:51.923731 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-22c6ca6e-2f79-4cf5-bf3c-0ef434a90a38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:51.959548 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-22c6ca6e-2f79-4cf5-bf3c-0ef434a90a38 None None] Port 5fd3adff-46db-4f6c-976b-1c61edeb54cb cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:11:52.148777 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5fd3adff-46db-4f6c-976b-1c61edeb54cb {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:11:52.156083 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:52.167521 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Transition to ACTIVE for port object 5fd3adff-46db-4f6c-976b-1c61edeb54cb will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:11:52.271513 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b3ada3-812c-489c-b780-0865010967d6 req-151e7c46-c57d-4824-b52d-14a0c8c3507b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:52.272971 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-33b3ada3-812c-489c-b780-0865010967d6 req-151e7c46-c57d-4824-b52d-14a0c8c3507b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 931 time: 0.0482786 Jan 05 15:11:52.285614 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:52.371359 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-33b3ada3-812c-489c-b780-0865010967d6 req-dee2bbb5-8bdb-4241-b64b-8471e05fe833 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0926166 Jan 05 15:11:52.371974 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Pushing event updated for resources: {'Port': ['ID=5fd3adff-46db-4f6c-976b-1c61edeb54cb,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:11:52.444319 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Attempting to bind port 5fd3adff-46db-4f6c-976b-1c61edeb54cb on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:11:52.444664 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Attempting to bind port 5fd3adff-46db-4f6c-976b-1c61edeb54cb by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:11:52.444996 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Attempting to bind port 5fd3adff-46db-4f6c-976b-1c61edeb54cb on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:11:52.450153 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Port 5fd3adff-46db-4f6c-976b-1c61edeb54cb on network b2bf0812-1bb3-4cbd-8030-193c492fed7f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:11:52.450483 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Attempting to bind port 5fd3adff-46db-4f6c-976b-1c61edeb54cb on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:11:52.455585 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:11:52.455930 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Checking segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:11:52.456318 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Bound using segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:11:52.456749 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Bound port: 5fd3adff-46db-4f6c-976b-1c61edeb54cb, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:11:52.457184 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:52.523609 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] For port 5fd3adff-46db-4f6c-976b-1c61edeb54cb, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:11:52.526782 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] For port 5fd3adff-46db-4f6c-976b-1c61edeb54cb, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:11:52.587987 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:52.629144 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:52.629706 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:52.631066 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] 10.222.0.13 "PUT /v2.0/ports/5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 200 len: 1093 time: 0.7978656 Jan 05 15:11:52.631499 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:11:52.633767 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52" -d '{"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:11:52.658539 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f3e052-85d3-413e-8df0-82a628eb854d service neutron] Pushing event updated for resources: {'Port': ['ID=5fd3adff-46db-4f6c-976b-1c61edeb54cb,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:11:52.677379 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:11:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a x-openstack-request-id: req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:11:52.677734 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:11:52.677995 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4e69d6ba-3f80-4b1e-8a40-974c2d56f35a {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:11:52.678407 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'status': 'completed', 'code': 200} Jan 05 15:11:52.760993 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-42c4e6c5-7bb7-4e47-a21e-35467bdb577a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:52.762524 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-42c4e6c5-7bb7-4e47-a21e-35467bdb577a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1096 time: 0.0432003 Jan 05 15:11:52.867001 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-4909d3bc-e7a7-4522-83fa-5bdebdbf0a2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:52.868440 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-4909d3bc-e7a7-4522-83fa-5bdebdbf0a2d service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=4ed05f9412d9477ea62f75cd05af148b&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0938721 Jan 05 15:11:52.957980 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-60bfc665-95ad-42f1-846d-516620ca3e27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:52.959421 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dee439dd-0db3-4bd9-8c90-b9cfcb303c52 req-60bfc665-95ad-42f1-846d-516620ca3e27 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0857491 Jan 05 15:11:53.053916 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-f9f21af4-4f7e-47c0-ab1a-4887b57cd665 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:53.055398 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-f9f21af4-4f7e-47c0-ab1a-4887b57cd665 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1096 time: 0.0413382 Jan 05 15:11:53.106612 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-64b6ac6f-a953-489f-ab58-42117d3388d0 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 200 len: 217 time: 0.0389986 Jan 05 15:11:53.155502 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-dc6efed4-0643-41ea-82a2-4cbd370b1d42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:53.157032 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-dc6efed4-0643-41ea-82a2-4cbd370b1d42 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0442238 Jan 05 15:11:53.203100 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-b68a42db-6ff2-45ea-9dd7-5687e6711beb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:53.204646 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-b68a42db-6ff2-45ea-9dd7-5687e6711beb service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409875 Jan 05 15:11:53.296172 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-cc8b53b3-9290-4894-a2fe-965a1d9d6561 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849738 Jan 05 15:11:53.380854 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9c13ad82-88ad-42bb-847f-62b8a1f03bb8 req-f1f01528-1267-4147-a10c-38286c65479e service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0789750 Jan 05 15:11:53.497130 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314fdafc-c2f4-49f0-bec6-443cf451783e req-085e4c79-8773-4a94-a699-c4b69ef45856 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:53.498631 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-314fdafc-c2f4-49f0-bec6-443cf451783e req-085e4c79-8773-4a94-a699-c4b69ef45856 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0497096 Jan 05 15:11:53.552783 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-314fdafc-c2f4-49f0-bec6-443cf451783e req-e336c3a3-1e89-4ae2-80c0-1323bae662fd tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480695 Jan 05 15:11:54.670108 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f72df2d8-e029-4b97-8ee8-d604c3d702ec req-6b439743-a860-4f36-912f-86ff49ab5207 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:54.671576 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f72df2d8-e029-4b97-8ee8-d604c3d702ec req-6b439743-a860-4f36-912f-86ff49ab5207 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0507076 Jan 05 15:11:54.719265 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f72df2d8-e029-4b97-8ee8-d604c3d702ec req-9e505d90-0bd4-49d9-bb3c-5ab6bcd0182d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420444 Jan 05 15:11:55.830300 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efabc98-10ea-46ff-ae8e-758585e6213f req-60eea68e-93c7-409c-b2ad-3bb08fcbe530 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:55.831653 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4efabc98-10ea-46ff-ae8e-758585e6213f req-60eea68e-93c7-409c-b2ad-3bb08fcbe530 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0476038 Jan 05 15:11:55.880054 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-4efabc98-10ea-46ff-ae8e-758585e6213f req-665ab1de-fc1f-439a-973f-f0830d84c837 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429988 Jan 05 15:11:56.994979 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f770c72-bead-446c-b405-677f21d10961 req-4f69170a-0b0c-4b03-be3f-be28010e9a8a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:56.996442 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8f770c72-bead-446c-b405-677f21d10961 req-4f69170a-0b0c-4b03-be3f-be28010e9a8a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0523109 Jan 05 15:11:57.043380 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8f770c72-bead-446c-b405-677f21d10961 req-b4355822-6e98-4500-9c4a-15f047876914 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414686 Jan 05 15:11:58.154983 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d805a8-bc9a-446f-ab25-984dde1389df req-80271956-f6c8-4f2b-a2eb-7abc5fa0076a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:58.156420 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b6d805a8-bc9a-446f-ab25-984dde1389df req-80271956-f6c8-4f2b-a2eb-7abc5fa0076a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0486419 Jan 05 15:11:58.195369 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e62dbaae-3a41-4aba-8d7c-c691d95d43ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:11:58.205251 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b6d805a8-bc9a-446f-ab25-984dde1389df req-91556278-9b35-4e50-81b0-77cfe7642ce9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432129 Jan 05 15:11:59.318142 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d971cbe-7daf-4267-9ba0-ea470db8186c req-45968931-cec9-428d-80fc-d02aaf246772 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:11:59.319591 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8d971cbe-7daf-4267-9ba0-ea470db8186c req-45968931-cec9-428d-80fc-d02aaf246772 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0466473 Jan 05 15:11:59.366215 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-8d971cbe-7daf-4267-9ba0-ea470db8186c req-ec302e16-7c84-4b9e-8fa3-126c76383556 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412924 Jan 05 15:12:00.412167 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-bd7b2fc7-2fad-4b60-9590-5c5c417e19d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:00.481282 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633f9025-110e-4e4e-8475-a14cfa93aa30 req-28ada517-113b-42d4-a27d-fdf438c47c8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:00.482811 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-633f9025-110e-4e4e-8475-a14cfa93aa30 req-28ada517-113b-42d4-a27d-fdf438c47c8c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0520182 Jan 05 15:12:00.531987 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-633f9025-110e-4e4e-8475-a14cfa93aa30 req-b7c1dcdd-4d19-4a03-8458-1657259220b3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429771 Jan 05 15:12:01.645852 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9245e781-47b7-4e98-a989-f37200e57b6a req-a829d8e7-d4d7-492f-986d-441b66166465 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:01.647301 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9245e781-47b7-4e98-a989-f37200e57b6a req-a829d8e7-d4d7-492f-986d-441b66166465 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0505507 Jan 05 15:12:01.694252 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9245e781-47b7-4e98-a989-f37200e57b6a req-542d7d1d-854a-455e-9b33-b034c1f6c88a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414886 Jan 05 15:12:01.845708 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:02.761036 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:02.802551 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 5fd3adff-46db-4f6c-976b-1c61edeb54cb details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:12:02.808749 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 req-0b1bc265-7fae-4348-8fdc-c3517974bbe2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:02.810252 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 req-0b1bc265-7fae-4348-8fdc-c3517974bbe2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 943 time: 0.0493600 Jan 05 15:12:02.861665 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-7b52043d-e08c-41ff-bfa5-7270ba0f63c2 req-cc3957c7-a6b3-43ff-bb3d-181f48fad9d3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453799 Jan 05 15:12:02.904842 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 5fd3adff-46db-4f6c-976b-1c61edeb54cb, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:12:03.044094 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 128, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:12:03.080112 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:03.092651 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5fd3adff-46db-4f6c-976b-1c61edeb54cb {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:12:03.111253 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 5fd3adff-46db-4f6c-976b-1c61edeb54cb, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:12:03.178347 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:03.224904 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=5fd3adff-46db-4f6c-976b-1c61edeb54cb,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:12:03.231682 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.232036 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.232384 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.232723 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.233058 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.233416 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.233759 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.234086 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.234418 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.234748 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.235078 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.235404 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.235730 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:03.454144 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['5fd3adff-46db-4f6c-976b-1c61edeb54cb'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:12:03.681144 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:03.973755 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73838a8-10bf-4a25-a614-8d9267d156a5 req-0fa1a4f7-2214-40e9-96ad-fa4f2115a35e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:03.975209 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f73838a8-10bf-4a25-a614-8d9267d156a5 req-0fa1a4f7-2214-40e9-96ad-fa4f2115a35e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 944 time: 0.0477986 Jan 05 15:12:04.024557 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-f73838a8-10bf-4a25-a614-8d9267d156a5 req-76c002fe-bcae-4b58-a1fa-7239cef2eea0 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438626 Jan 05 15:12:04.395130 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:04.837782 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 5fd3adff-46db-4f6c-976b-1c61edeb54cb up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:12:05.010367 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 5fd3adff-46db-4f6c-976b-1c61edeb54cb completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:12:05.014370 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 5fd3adff-46db-4f6c-976b-1c61edeb54cb triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:12:05.014740 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:05.100577 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:05.123600 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:12:05.126236 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3152ad7f-0443-4196-b248-9fa3c23d4a63" -d '{"events": [{"server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "name": "network-vif-plugged", "status": "completed", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:12:05.139940 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 5fd3adff-46db-4f6c-976b-1c61edeb54cb, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:12:05.152159 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11cacaf9-597f-45cd-930b-121f340ece87 req-e595603d-ca2a-4ce4-8973-0c666ea448b7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:05.153658 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-11cacaf9-597f-45cd-930b-121f340ece87 req-e595603d-ca2a-4ce4-8973-0c666ea448b7 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 944 time: 0.0547481 Jan 05 15:12:05.203300 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-11cacaf9-597f-45cd-930b-121f340ece87 req-0c17daeb-01ab-43f2-8cff-2a6a6e1bed25 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438607 Jan 05 15:12:05.217323 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:12:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e884aa46-7fc0-42ce-a447-8b6b4322e416 x-openstack-request-id: req-e884aa46-7fc0-42ce-a447-8b6b4322e416 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:12:05.217621 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "name": "network-vif-plugged", "status": "completed", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:12:05.217879 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e884aa46-7fc0-42ce-a447-8b6b4322e416 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:12:05.218277 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'code': 200} Jan 05 15:12:05.221610 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:05.271492 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=5fd3adff-46db-4f6c-976b-1c61edeb54cb,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:12:05.720228 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366add58-db72-4af3-a758-83bf3fece496 req-bcb71fd9-06e5-4137-add5-ecaa15d605f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:05.721729 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-366add58-db72-4af3-a758-83bf3fece496 req-bcb71fd9-06e5-4137-add5-ecaa15d605f7 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1098 time: 0.0386381 Jan 05 15:12:05.765833 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-366add58-db72-4af3-a758-83bf3fece496 req-2f54d419-31aa-401e-8d6b-672855e899ee service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378456 Jan 05 15:12:06.316097 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e req-6d728cfa-5f31-4447-ac0d-f1ddcf75193c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:06.317561 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e req-6d728cfa-5f31-4447-ac0d-f1ddcf75193c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 945 time: 0.0470378 Jan 05 15:12:06.368371 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-9943c17a-8c7c-434c-a8d4-6a47da88ef0e req-a5ff1956-35c7-42d4-affc-48c337a0e061 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454011 Jan 05 15:12:07.481101 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 req-b6255f70-0d80-4155-a672-669ba9e67307 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:07.482482 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 req-b6255f70-0d80-4155-a672-669ba9e67307 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 945 time: 0.0475974 Jan 05 15:12:07.534687 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7d8557ef-e5a9-4293-ac5e-4da6f61395b1 req-8a0dee2b-1aec-427f-8e29-1c8a8ab4782b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461204 Jan 05 15:12:07.643971 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-670cc92e-541d-485f-aab6-cc8ab880ed29 req-976fc7ef-1c6e-49b6-87da-52dede93bf76 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:07.645435 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-670cc92e-541d-485f-aab6-cc8ab880ed29 req-976fc7ef-1c6e-49b6-87da-52dede93bf76 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 945 time: 0.0471287 Jan 05 15:12:07.693285 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-670cc92e-541d-485f-aab6-cc8ab880ed29 req-be551d23-fc47-40d7-bf6f-62857d287398 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423191 Jan 05 15:12:07.714442 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52586) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:12:07.753421 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-050a7512-5a6f-4deb-85cd-efae2b9f93f9 tempest-TestVolumeBootPattern-1804168086 tempest-TestVolumeBootPattern-1804168086-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:07.755536 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-050a7512-5a6f-4deb-85cd-efae2b9f93f9 tempest-TestVolumeBootPattern-1804168086 tempest-TestVolumeBootPattern-1804168086-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1093 time: 0.0400560 Jan 05 15:12:07.758257 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52588) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:12:07.762596 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address': '172.20.0.8'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:12:07.850335 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:07.942118 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:08.045595 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Allocated IP 172.37.2.73 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/f43c0e41-ad1b-44ce-9213-29757a3d028b) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:12:08.142254 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:08.241146 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:08.280624 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:12:08.283392 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:12:08.287050 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:12:08.311052 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=f43c0e41-ad1b-44ce-9213-29757a3d028b,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:12:08.324114 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.324458 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.324796 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.325152 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.325482 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.325817 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.326128 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.326450 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.326771 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.327089 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.327404 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.327718 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.328030 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:12:08.645204 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:08.762938 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:08.907018 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:08.964029 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:09.030534 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=f43c0e41-ad1b-44ce-9213-29757a3d028b,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:12:09.040432 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:09.137098 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Floating IP fc407f55-932f-41f2-9ba5-eeba6d64b0b8 associated. External IP: 172.37.2.73, port: 5fd3adff-46db-4f6c-976b-1c61edeb54cb. Jan 05 15:12:09.338201 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:12:09.440937 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:12:09.450786 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:12:09.460234 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:12:09.460834 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:12:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:12:09.526794 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:09.563364 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5ff51a1a-54d7-4615-a1ab-24718547311f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7940514 Jan 05 15:12:09.563364 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:12:09.563364 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c37da17b-05f5-4212-ba62-0a904d636db7" -d '{"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:12:09.567659 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:12:09.645733 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:12:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11571917-3075-4a88-b83b-77e58b0e109b x-openstack-request-id: req-11571917-3075-4a88-b83b-77e58b0e109b {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:12:09.646223 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:12:09.646319 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-11571917-3075-4a88-b83b-77e58b0e109b {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:12:09.646680 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'status': 'completed', 'code': 200} Jan 05 15:12:09.727754 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-c987a5f1-fd79-4a82-9573-e35b439a4cf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:09.729369 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-c987a5f1-fd79-4a82-9573-e35b439a4cf5 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1098 time: 0.0403688 Jan 05 15:12:09.789039 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:08Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:12:09.814526 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:12:09.818488 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-4acfd08d-1c61-4f6b-a027-b5642f66af8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:09.820011 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-4acfd08d-1c61-4f6b-a027-b5642f66af8c service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0850861 Jan 05 15:12:09.823239 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:12:09.823837 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:12:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:12:09.883026 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-f12cad86-44b9-4b96-a99d-abd1b6eaf27b service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 200 len: 998 time: 0.0573647 Jan 05 15:12:09.929411 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:12:09.929823 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-e26c61a6-0cd6-418a-8dbd-d3aeb89defbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:09.931269 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-e26c61a6-0cd6-418a-8dbd-d3aeb89defbf service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0425529 Jan 05 15:12:09.979878 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-09b2996a-3758-4088-9f31-fe1e9e36fad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:09.981557 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-09b2996a-3758-4088-9f31-fe1e9e36fad3 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0441368 Jan 05 15:12:10.069545 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-00a8653e-d039-454a-ae53-e5f13001776d service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818264 Jan 05 15:12:10.149741 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:08Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:12:10.162898 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c37da17b-05f5-4212-ba62-0a904d636db7 req-2df57ef1-93ec-496d-b84e-b93b4e1457d6 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874798 Jan 05 15:12:10.179710 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7181501-58f2-4287-9c96-3dbf7232260d None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:08Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:12:10.360545 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffcdbab7-608b-41bf-83a8-6dc2eacc36a9 None None] New status for floating IP fc407f55-932f-41f2-9ba5-eeba6d64b0b8: ACTIVE {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:12:24.041718 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:12:28.171613 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-9c1aaba2-c4db-4b86-bac9-58894d2041f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:30.369267 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e0761cd6-108c-464f-98b3-c07156cef841 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:31.861144 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:32.754413 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:33.672065 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:34.434357 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:12:41.847849 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-911c7350-18bc-4613-890f-a6145b5c7488 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0387244 Jan 05 15:12:41.942826 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-e894ca7a-ddb5-4087-ab6f-72a49bff7d08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:41.944275 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-e894ca7a-ddb5-4087-ab6f-72a49bff7d08 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1098 time: 0.0399342 Jan 05 15:12:42.045422 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-b7a19db7-79af-4b92-af6d-0ff52101ddde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:42.046881 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-b7a19db7-79af-4b92-af6d-0ff52101ddde service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0857127 Jan 05 15:12:42.110458 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-68e38f4c-5383-42c8-aecc-510cc1b7c3d5 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 200 len: 1000 time: 0.0570240 Jan 05 15:12:42.156522 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-82be46c2-e564-4866-aaeb-38e64bac29a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:42.157946 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-82be46c2-e564-4866-aaeb-38e64bac29a6 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0414929 Jan 05 15:12:42.203876 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-1a2619a6-0646-424e-ae84-6ccf05b409e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:12:42.205332 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-1a2619a6-0646-424e-ae84-6ccf05b409e9 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408552 Jan 05 15:12:42.290346 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-c3e63e80-d9d5-41cf-aebc-deeaff66ec2d service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789180 Jan 05 15:12:42.378590 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-40600161-49d8-46ca-b7cb-36f8081fa126 req-ab426e37-42ba-42e5-bb12-4a0d27950482 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820570 Jan 05 15:12:58.174566 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ca99f815-6dbe-4d0b-8c05-3fd78bba309f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:00.374219 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-55839da6-5da2-4294-a9b6-3b9697607730 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:01.040158 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:13:01.850673 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:02.762835 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:03.679250 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:04.439494 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:28.173670 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2c5dde4b-19de-43fe-884c-fd7250600274 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:30.381015 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-0ce585b8-0c61-41df-af81-981b4a612aad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:31.861209 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:32.770150 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:33.678229 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:34.415446 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:38.038806 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:13:41.116535 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-f3a25b59-2de8-40d8-84db-b6760b75ec91 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385380 Jan 05 15:13:41.209791 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-390803dc-e939-40f1-ab69-f4247a0a5ae8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:41.211246 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-390803dc-e939-40f1-ab69-f4247a0a5ae8 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1098 time: 0.0396080 Jan 05 15:13:41.315547 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-7bfe7cc5-1dcc-4719-9f4d-edbc8fdc951b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:41.316989 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-7bfe7cc5-1dcc-4719-9f4d-edbc8fdc951b service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0888667 Jan 05 15:13:41.381029 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-68732737-984e-4b27-ab99-a936ddf9eefb service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 200 len: 1000 time: 0.0584576 Jan 05 15:13:41.427656 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-a7721858-ee94-4592-8c9a-e610898bad0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:41.429122 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-a7721858-ee94-4592-8c9a-e610898bad0d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0428412 Jan 05 15:13:41.475429 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-a4af3374-ff88-4de8-b673-f8bb835f3e6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:41.476982 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-a4af3374-ff88-4de8-b673-f8bb835f3e6d service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0426960 Jan 05 15:13:41.564548 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-9e47b778-8b07-424a-93f4-d17834a4989a service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818558 Jan 05 15:13:41.659099 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fcf5145e-ee47-445e-a1fe-17f31154bb48 req-98767372-f0cf-49de-bdde-aab1f82df246 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881066 Jan 05 15:13:43.965581 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-5ac7ce00-05dd-410e-a66d-e23a141eae53 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-369949876&fields=id&tenant_id=4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 267 time: 0.0438838 Jan 05 15:13:44.066357 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-80c9a247-ca8d-40eb-b07d-17443e469914 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:44.067711 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-80c9a247-ca8d-40eb-b07d-17443e469914 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 810 time: 0.0956619 Jan 05 15:13:44.082242 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-9bfb2e44-1cf0-4ab5-b35b-9f01eed1cc1a tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/quotas/4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 375 time: 0.0092859 Jan 05 15:13:44.136087 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-abbdb7a0-4013-454c-89c1-6a16e7560014 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0492203 Jan 05 15:13:44.225400 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-3cad0fe3-467b-4d79-bcc6-449f68cc3b92 service neutron] 10.222.0.30 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0781248 Jan 05 15:13:44.315553 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-41106a16-0457-434a-be97-514ddf3e9471 service neutron] 10.222.0.30 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847101 Jan 05 15:13:44.834663 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bf1f7739-feea-4e15-ac2b-58bd9c5527ac req-2d4b137d-fd4d-4b07-a29f-f6e0c3e1f575 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0273621 Jan 05 15:13:45.909417 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-68add5de-bb27-42de-bcb8-b0f3943b03ae req-ce07337a-7171-48ab-95df-e5e8bfd375f0 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0255580 Jan 05 15:13:46.989672 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-77bd514b-bae9-49d3-ae3c-e95104b2274b req-3df25239-4fb7-4156-95fd-94dd1032c9bc tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0296683 Jan 05 15:13:48.072101 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-c9000383-6565-4774-b04b-2d447fd9bc09 req-7b30f75d-907b-48c2-adf4-5c95e0f4d727 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0323172 Jan 05 15:13:49.162670 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4c6106e6-e55b-4b72-8cc3-fc55032176d1 req-c0aec663-a7a8-44b6-ae12-a5fc0562b123 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0255520 Jan 05 15:13:50.253556 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-58570900-b6ee-403f-9b50-81b55f963377 req-0853d26c-f860-4187-87fb-f520a9f38767 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0249562 Jan 05 15:13:50.832649 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-2ef3bc5e-bd36-4122-88c3-fa1e07422a1b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:50.834051 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-2ef3bc5e-bd36-4122-88c3-fa1e07422a1b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 810 time: 0.1041327 Jan 05 15:13:50.901018 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-97ac850e-eacf-4c45-ab2a-6cf72496fb64 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=4ed05f9412d9477ea62f75cd05af148b HTTP/1.1" status: 200 len: 379 time: 0.0534360 Jan 05 15:13:50.912314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'port': {'device_id': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'admin_state_up': True, 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'security_groups': ['a2c3d224-9c0a-4ff5-980a-10e9592f96c9']}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:13:51.066494 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Made reservation on behalf of 4ed05f9412d9477ea62f75cd05af148b for: {'port': 1} {{(pid=114654) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jan 05 15:13:51.070226 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:51.194148 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.db_base_plugin_common [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Allocated IP 172.20.0.7 (b2bf0812-1bb3-4cbd-8030-193c492fed7f/4edb11eb-ca12-4d58-bf53-1c547357436d/113c50f8-3fe6-4232-9abc-c3a1f377fc13) {{(pid=114654) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:13:51.328134 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:51.347018 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-bba6dbe6-0e17-45bd-9105-3c5f0a77fb52 req-e8e95e61-9a40-4d74-962c-1564f40de5a2 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0258806 Jan 05 15:13:51.426981 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_create {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:51.467314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f is already hosted by enough agents. {{(pid=114654) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:13:51.470540 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.base_scheduler [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Resources bound (agent type, host, resource id): {{(pid=114654) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:13:51.474334 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Received port after_create {{(pid=114654) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:13:51.501628 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=113c50f8-3fe6-4232-9abc-c3a1f377fc13,revision_number=1']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:13:51.516545 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.516903 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.517293 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.517708 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.518020 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.518270 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.518600 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.518928 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.519258 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.519585 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.519916 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.520237 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.520683 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:13:51.542928 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:51.543781 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:51.629761 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-e8d25ebe-278d-43c7-a80d-b59027d4e97f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7208977 Jan 05 15:13:51.646354 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.v2.base [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Request body: {'port': {'device_id': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-maste'}} {{(pid=114654) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:13:51.699840 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-17d0dfe7-fdcd-4eb4-bad7-4282249dabd1 None None] Provisioning complete for port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 triggered by entity DHCP. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:13:51.700448 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-17d0dfe7-fdcd-4eb4-bad7-4282249dabd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:51.703817 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:51.738078 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-17d0dfe7-fdcd-4eb4-bad7-4282249dabd1 None None] Port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 cannot update to ACTIVE because it is not bound. {{(pid=114656) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Jan 05 15:13:51.961526 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 113c50f8-3fe6-4232-9abc-c3a1f377fc13 {{(pid=114654) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:13:51.968772 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Publish callbacks [] for port, precommit_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:51.980822 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.provisioning_blocks [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Transition to ACTIVE for port object 113c50f8-3fe6-4232-9abc-c3a1f377fc13 will not be triggered until provisioned by entity L2. {{(pid=114654) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jan 05 15:13:52.076029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:52.126299 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Pushing event updated for resources: {'Port': ['ID=113c50f8-3fe6-4232-9abc-c3a1f377fc13,revision_number=2']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:13:52.197846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Attempting to bind port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 on host hv-cinder-maste for vnic_type normal with profile {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Jan 05 15:13:52.198180 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Attempting to bind port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 by drivers openvswitch,hyperv on host hv-cinder-maste at level 0 using segments [{'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Jan 05 15:13:52.198504 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Attempting to bind port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:13:52.203733 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 on network b2bf0812-1bb3-4cbd-8030-193c492fed7f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-maste {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Jan 05 15:13:52.204048 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Attempting to bind port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 on network b2bf0812-1bb3-4cbd-8030-193c492fed7f {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Jan 05 15:13:52.208827 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Checking agent: {'id': '6c2c3080-4abb-4508-9d80-0474ab48272e', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-maste', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'started_at': datetime.datetime(2022, 1, 5, 14, 57, 32), 'heartbeat_timestamp': datetime.datetime(2022, 1, 5, 15, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Jan 05 15:13:52.209194 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Checking segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=114654) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Jan 05 15:13:52.209573 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Bound using segment: {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'} {{(pid=114654) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Jan 05 15:13:52.210567 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.managers [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Bound port: 113c50f8-3fe6-4232-9abc-c3a1f377fc13, host: hv-cinder-maste, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '101c0dad-0651-4b26-b7e8-40146cbcf385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f'}}] {{(pid=114654) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Jan 05 15:13:52.210936 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:52.275134 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] For port 113c50f8-3fe6-4232-9abc-c3a1f377fc13, host hv-cinder-maste, cleared binding levels {{(pid=114654) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Jan 05 15:13:52.278602 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] For port 113c50f8-3fe6-4232-9abc-c3a1f377fc13, host hv-cinder-maste, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114654) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Jan 05 15:13:52.345317 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8859515'] for port, after_update {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:52.390128 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:52.390744 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:52.392116 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] 10.222.0.13 "PUT /v2.0/ports/113c50f8-3fe6-4232-9abc-c3a1f377fc13 HTTP/1.1" status: 200 len: 1093 time: 0.7501316 Jan 05 15:13:52.392580 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:13:52.394839 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c" -d '{"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:13:52.424218 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-149e0a5b-86a6-4bff-9a09-b4c00616bd0c service neutron] Pushing event updated for resources: {'Port': ['ID=113c50f8-3fe6-4232-9abc-c3a1f377fc13,revision_number=3']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:13:52.725279 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:13:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 x-openstack-request-id: req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:13:52.725555 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:13:52.725805 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e56cfb8b-40e8-4c44-a147-544b2ddbc077 {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:13:52.726195 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'status': 'completed', 'code': 200} Jan 05 15:13:52.772212 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 req-d3fe6860-7ef5-4eef-b3a2-9f3bb9f049f4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:52.773620 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 req-d3fe6860-7ef5-4eef-b3a2-9f3bb9f049f4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.3395972 Jan 05 15:13:52.787751 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-f5fe3809-f6ee-4882-aa8e-ac40caf573f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:52.789184 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-f5fe3809-f6ee-4882-aa8e-ac40caf573f4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 1096 time: 0.0618849 Jan 05 15:13:52.868991 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ae5a795a-dfb2-45e3-91ca-31d60d6b0f48 req-e935f26b-6917-4fcd-95a4-87d27a26c75e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0881848 Jan 05 15:13:52.911036 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-6b68e3b5-53c8-4be9-a1ae-30d2eb8ad0e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:52.917311 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-6b68e3b5-53c8-4be9-a1ae-30d2eb8ad0e7 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=4ed05f9412d9477ea62f75cd05af148b&shared=False HTTP/1.1" status: 200 len: 911 time: 0.1099405 Jan 05 15:13:53.003741 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-1efb4195-e23e-4536-9821-e9362fe0dbcd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:53.005415 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e72fa5d5-25bd-4004-acbb-cffaf693ea3c req-1efb4195-e23e-4536-9821-e9362fe0dbcd service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0870509 Jan 05 15:13:53.101135 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-c6c34431-3a80-4f91-8fcc-7b56e3517397 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:53.102475 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-c6c34431-3a80-4f91-8fcc-7b56e3517397 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 1096 time: 0.0393331 Jan 05 15:13:53.149709 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-ed4641f5-a861-4685-a60f-03b3dd0545f6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13 HTTP/1.1" status: 200 len: 217 time: 0.0351100 Jan 05 15:13:53.195205 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-bb477c53-0149-4222-9ea2-d60be522af07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:53.196566 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-bb477c53-0149-4222-9ea2-d60be522af07 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0407183 Jan 05 15:13:53.238956 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-d0813f6b-b227-4713-a242-4fe53f6816c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:53.240373 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-d0813f6b-b227-4713-a242-4fe53f6816c0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0381348 Jan 05 15:13:53.328450 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-c9075fae-3945-483e-a83a-256dfc4de98a service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825031 Jan 05 15:13:53.417817 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-dbdbf944-7267-4cf7-95c1-d04ec7838eb7 req-8af77dff-0d0f-4bd6-b19b-15db7b82b342 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825047 Jan 05 15:13:53.982100 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f req-40af89a6-9160-43cf-9678-2dafbf004857 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:53.984040 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f req-40af89a6-9160-43cf-9678-2dafbf004857 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.0472343 Jan 05 15:13:54.030261 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2b9e7575-0baf-48f7-8d5c-75bdbb129c7f req-ebcd234d-1fc7-46e4-8c71-ff7341aa3a91 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408468 Jan 05 15:13:55.146196 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e6146b-2f50-4cfc-b6b6-083d145d85bc req-60f883d0-60d5-4d18-a49a-c1f2bb973577 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:55.147648 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-00e6146b-2f50-4cfc-b6b6-083d145d85bc req-60f883d0-60d5-4d18-a49a-c1f2bb973577 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.0530629 Jan 05 15:13:55.194171 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-00e6146b-2f50-4cfc-b6b6-083d145d85bc req-a0189b06-0c6e-4e03-b8cb-3be18d00a7b4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411570 Jan 05 15:13:56.307562 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-befaaaa7-0e0d-4612-bc72-1837bebd5356 req-19c3e21a-7106-4ac5-add4-28ce50189bbb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:56.308990 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-befaaaa7-0e0d-4612-bc72-1837bebd5356 req-19c3e21a-7106-4ac5-add4-28ce50189bbb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.0495954 Jan 05 15:13:56.356133 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-befaaaa7-0e0d-4612-bc72-1837bebd5356 req-e04cbf97-29c2-4fc0-922e-b4fe4af523ec tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409801 Jan 05 15:13:57.467708 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 req-f0c5421c-7da7-4765-a959-fb6153dcac10 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:57.469207 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 req-f0c5421c-7da7-4765-a959-fb6153dcac10 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.0479751 Jan 05 15:13:57.517407 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b9e87983-0ea2-4f62-8ff7-4aefb838b1e3 req-f8c4f023-2d37-4f36-9f4f-145e830d7447 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425305 Jan 05 15:13:58.186244 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a480a916-6ddc-4dff-8203-333ae0754f46 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:13:58.626922 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7572a341-12e8-4495-aaa4-dd8eb3be8655 req-08bd4d6b-5cda-4b6a-87f8-6e5d68cc33c6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:58.628374 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7572a341-12e8-4495-aaa4-dd8eb3be8655 req-08bd4d6b-5cda-4b6a-87f8-6e5d68cc33c6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.0471182 Jan 05 15:13:58.675815 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-7572a341-12e8-4495-aaa4-dd8eb3be8655 req-2fd15538-e7a6-4643-ae18-169bffc0b9e4 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419526 Jan 05 15:13:59.866579 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff3c3add-5013-4ba5-a299-198abd12df51 req-9f3af51b-8cdd-415b-b123-edd9b48322a0 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:13:59.868044 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ff3c3add-5013-4ba5-a299-198abd12df51 req-9f3af51b-8cdd-415b-b123-edd9b48322a0 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.0479023 Jan 05 15:13:59.919153 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-ff3c3add-5013-4ba5-a299-198abd12df51 req-0549bc97-148b-4ba4-a68c-c66cca981451 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457158 Jan 05 15:14:00.369215 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-e888898f-d611-495f-a1f3-9ac4e6c9d0b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:01.032443 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19827b39-9b83-4288-b392-be80e17d2943 req-267e2716-2fca-4b0c-89c5-29d6542209e1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:01.033928 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-19827b39-9b83-4288-b392-be80e17d2943 req-267e2716-2fca-4b0c-89c5-29d6542209e1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 943 time: 0.0475907 Jan 05 15:14:01.084731 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-19827b39-9b83-4288-b392-be80e17d2943 req-69a24e6f-ae95-4f32-ac0b-2e41c1e3f5ef tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452547 Jan 05 15:14:01.450941 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 113c50f8-3fe6-4232-9abc-c3a1f377fc13 details requested by agent hyperv_hv-cinder-maste with host hv-cinder-maste {{(pid=114656) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Jan 05 15:14:01.545486 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 113c50f8-3fe6-4232-9abc-c3a1f377fc13, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:14:01.557089 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Returning: {'device': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'port_id': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'mac_address': 'fa:16:3e:16:97:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 128, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=114656) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Jan 05 15:14:01.593523 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:01.606600 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 113c50f8-3fe6-4232-9abc-c3a1f377fc13 {{(pid=114656) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jan 05 15:14:01.625984 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 113c50f8-3fe6-4232-9abc-c3a1f377fc13, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:14:01.682994 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:01.732247 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=113c50f8-3fe6-4232-9abc-c3a1f377fc13,revision_number=4']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:14:01.739914 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.740265 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.740611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.740949 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.741316 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.741650 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.741984 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.742310 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.742638 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.742962 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.743285 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.743604 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.743921 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:01.854724 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:01.970969 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] get_ports_and_sgs() called for port_ids ['113c50f8-3fe6-4232-9abc-c3a1f377fc13'] {{(pid=114656) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Jan 05 15:14:02.196594 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1463d70-a7ef-4d21-85ee-cbf366137133 req-7a4e1a80-0bad-44f2-9511-8a7de3858c35 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:02.198087 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1463d70-a7ef-4d21-85ee-cbf366137133 req-7a4e1a80-0bad-44f2-9511-8a7de3858c35 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 944 time: 0.0479293 Jan 05 15:14:02.245975 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-e1463d70-a7ef-4d21-85ee-cbf366137133 req-0aa0e991-e15d-4277-b480-9a9b4f2d6084 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417709 Jan 05 15:14:02.778561 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:03.357208 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b2b22be-460b-4967-8509-19de6325a168 req-f7714b8e-00f1-47e2-96fe-fee45f7d63b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:03.359289 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4b2b22be-460b-4967-8509-19de6325a168 req-f7714b8e-00f1-47e2-96fe-fee45f7d63b1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 944 time: 0.0474594 Jan 05 15:14:03.407872 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-4b2b22be-460b-4967-8509-19de6325a168 req-98646181-cb30-4c36-aa02-804b8bd02d31 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408754 Jan 05 15:14:03.485836 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 113c50f8-3fe6-4232-9abc-c3a1f377fc13 up at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Jan 05 15:14:03.643380 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning for port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 completed by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jan 05 15:14:03.647036 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.provisioning_blocks [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Provisioning complete for port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 triggered by entity L2. {{(pid=114656) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jan 05 15:14:03.647400 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-4154012'] for port, provisioning_complete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:03.846829 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:03.857845 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:03.878978 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13'}] {{(pid=114656) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:14:03.881226 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}666f4c58e84b695f9ad69a1147aef052d1f205e89a3ef9168e761b4ebc2c612b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4ca78eb-9118-405e-b6c0-63dbc6d495fd" -d '{"events": [{"server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "name": "network-vif-plugged", "status": "completed", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]}' {{(pid=114656) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:14:03.894278 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] For port 113c50f8-3fe6-4232-9abc-c3a1f377fc13, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:14:03.980822 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673'] for port, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:04.027032 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Pushing event updated for resources: {'Port': ['ID=113c50f8-3fe6-4232-9abc-c3a1f377fc13,revision_number=5']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:14:04.420457 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:04.520522 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52ebca3-57d1-408b-9d4e-e8e0969db355 req-6f203f3e-0ae8-472b-ae65-302a13a69044 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:04.522039 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c52ebca3-57d1-408b-9d4e-e8e0969db355 req-6f203f3e-0ae8-472b-ae65-302a13a69044 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 945 time: 0.0486989 Jan 05 15:14:04.570221 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-c52ebca3-57d1-408b-9d4e-e8e0969db355 req-e084a201-bb4e-4060-962c-9082404d343c tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425730 Jan 05 15:14:04.927161 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:14:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 x-openstack-request-id: req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:14:04.927606 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "name": "network-vif-plugged", "status": "completed", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13", "code": 200}]} {{(pid=114656) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:14:04.927706 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-44f18818-5aa4-4572-8ab0-0ca25ecf7928 {{(pid=114656) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:14:04.928082 dv-cinder-master-3-iscsi neutron-server[114656]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'code': 200} Jan 05 15:14:05.390846 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a94db4-666f-4b2b-b43d-e523e5ffaff1 req-817cfed3-7d72-49bc-ae97-f3b4f524cb62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:05.392279 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b8a94db4-666f-4b2b-b43d-e523e5ffaff1 req-817cfed3-7d72-49bc-ae97-f3b4f524cb62 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 1098 time: 0.0382755 Jan 05 15:14:05.439151 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-b8a94db4-666f-4b2b-b43d-e523e5ffaff1 req-d6dcc743-dde3-4e82-82d5-4cbb9384cf11 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394211 Jan 05 15:14:05.684404 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9659f4b0-85b0-4144-be56-5d6d12d958f8 req-b20d3340-a168-4280-b281-261337959aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:05.685774 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9659f4b0-85b0-4144-be56-5d6d12d958f8 req-b20d3340-a168-4280-b281-261337959aaa tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 945 time: 0.0510712 Jan 05 15:14:05.736493 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-9659f4b0-85b0-4144-be56-5d6d12d958f8 req-02e77034-ad90-48b3-b2f1-683c6e78a2a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446844 Jan 05 15:14:06.854392 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a req-934324d1-d167-4d2e-9bf9-5b7b86bd3f53 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:06.855835 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a req-934324d1-d167-4d2e-9bf9-5b7b86bd3f53 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 945 time: 0.0516150 Jan 05 15:14:06.902663 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cafe6629-c1cc-44c5-8600-2c7bc7ec200a req-fdd26ca0-110c-40b3-8724-1f9fdeeb254d tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413406 Jan 05 15:14:07.014414 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e920273f-8e81-4eab-a962-d7a1cad37669 req-88013fe5-1fd4-4ea7-aa10-2c016491f2c3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:07.015758 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e920273f-8e81-4eab-a962-d7a1cad37669 req-88013fe5-1fd4-4ea7-aa10-2c016491f2c3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 945 time: 0.0490265 Jan 05 15:14:07.063457 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-e920273f-8e81-4eab-a962-d7a1cad37669 req-9b2b4e05-e275-43ee-8770-4c4565c94619 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414312 Jan 05 15:14:07.085805 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52732) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:14:07.122824 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63abc572-38e9-42bb-8ca5-d5a9c2238a25 tempest-TestVolumeBootPattern-1804168086 tempest-TestVolumeBootPattern-1804168086-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:07.124274 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-63abc572-38e9-42bb-8ca5-d5a9c2238a25 tempest-TestVolumeBootPattern-1804168086 tempest-TestVolumeBootPattern-1804168086-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 1093 time: 0.0375283 Jan 05 15:14:07.127377 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52734) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:14:07.131457 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.v2.base [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Request body: {'floatingip': {'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'port_id': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address': '172.20.0.7'}} {{(pid=114655) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jan 05 15:14:07.209137 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:07.303173 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:07.406638 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_common [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Allocated IP 172.37.2.230 (5a23f40f-adea-4ffc-bf9d-36fc05b21ca9/bdce404c-f51c-4d0a-956e-f48c632a0324/9b277091-d6e0-4f83-839f-8f3f1a979c0c) {{(pid=114655) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jan 05 15:14:07.504384 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:07.586615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783775604637', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:07.622480 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Network 5a23f40f-adea-4ffc-bf9d-36fc05b21ca9 is already hosted by enough agents. {{(pid=114655) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jan 05 15:14:07.625370 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.base_scheduler [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Resources bound (agent type, host, resource id): {{(pid=114655) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jan 05 15:14:07.629256 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Received port after_create {{(pid=114655) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Jan 05 15:14:07.636288 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=9b277091-d6e0-4f83-839f-8f3f1a979c0c,revision_number=1']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:14:07.665916 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.666263 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.666601 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.666932 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.667259 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.667581 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.667901 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.668222 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.668541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.668860 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.669210 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.669523 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:07.669834 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:14:08.006350 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, precommit_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:08.134239 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-4135535'] for port, before_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:08.274302 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for port, precommit_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:08.334662 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783776005901', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783775604655', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783775604673', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4698994'] for port, after_update {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:08.410128 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event updated for resources: {'Port': ['ID=9b277091-d6e0-4f83-839f-8f3f1a979c0c,revision_number=2']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:14:08.421002 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-714208'] for floatingip, after_create {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:08.518403 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Floating IP 651899ae-411d-444d-98d2-ef4ec0751712 associated. External IP: 172.37.2.230, port: 113c50f8-3fe6-4232-9abc-c3a1f377fc13. Jan 05 15:14:08.963318 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:14:09.078814 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:14:09.088763 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:14:09.097855 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:14:09.106311 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:14:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:14:09.165559 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:09.192316 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-476f970b-475e-44d0-8104-829998bb81a1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0639124 Jan 05 15:14:09.192898 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:14:09.195122 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c" -d '{"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:14:09.206439 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:14:09.230470 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:14:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4fa6fe8-c784-42cf-8131-bafe42913fdf x-openstack-request-id: req-e4fa6fe8-c784-42cf-8131-bafe42913fdf {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:14:09.230757 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:14:09.231005 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e4fa6fe8-c784-42cf-8131-bafe42913fdf {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:14:09.231397 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'status': 'completed', 'code': 200} Jan 05 15:14:09.313314 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-4f2bc8ee-764e-42cc-a65f-a7f0eb5ef42b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:09.314846 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-4f2bc8ee-764e-42cc-a65f-a7f0eb5ef42b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 1098 time: 0.0400538 Jan 05 15:14:09.404437 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-48d22718-4dac-461b-b7f2-963a4d3596b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:09.405945 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-48d22718-4dac-461b-b7f2-963a4d3596b7 service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0850093 Jan 05 15:14:09.426538 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '651899ae-411d-444d-98d2-ef4ec0751712', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.230', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:16:97:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:14:07Z', 'updated_at': '2022-01-05T15:14:07Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}, {'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:10Z', 'revision_number': 1, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:14:09.455505 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:14:09.463619 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:14:09.464220 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:14:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:14:09.471095 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-0d1538b5-2a9d-497e-9640-232f2730af93 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13 HTTP/1.1" status: 200 len: 999 time: 0.0577898 Jan 05 15:14:09.518067 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-6548bcaa-4d4b-446a-b6d9-720a13a196af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:09.519531 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-6548bcaa-4d4b-446a-b6d9-720a13a196af service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0427201 Jan 05 15:14:09.566899 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-e1957124-03c8-4948-9c3d-3ff330c12504 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:09.568239 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:14:09.568383 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-e1957124-03c8-4948-9c3d-3ff330c12504 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0434010 Jan 05 15:14:09.654537 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-fc152903-c008-44b9-af41-4f64afac5ae2 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800946 Jan 05 15:14:09.745488 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fcfebcb-2ae6-40d7-8c4f-53823314bf8c req-fde9b698-ceb9-4db6-8446-7e817efabf20 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837517 Jan 05 15:14:09.792293 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '651899ae-411d-444d-98d2-ef4ec0751712', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.230', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:16:97:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:14:07Z', 'updated_at': '2022-01-05T15:14:07Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}, {'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:10Z', 'revision_number': 1, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:14:09.816923 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a42bb73-442b-4007-979a-56903720a5a1 None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': '651899ae-411d-444d-98d2-ef4ec0751712', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.230', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:16:97:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:14:07Z', 'updated_at': '2022-01-05T15:14:07Z', 'revision_number': 0, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}, {'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:10Z', 'revision_number': 1, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:14:10.000196 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f88ebdfb-014d-4727-b68b-dffa54683271 None None] New status for floating IP 651899ae-411d-444d-98d2-ef4ec0751712: ACTIVE {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:14:15.037836 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:14:28.168810 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-00c57db3-6c2a-4a03-87f4-e5119faccfcc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:30.373905 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-4e487304-6896-4cf9-9061-f53aacbf27f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:31.869194 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:32.790961 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:33.686517 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:34.440643 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:14:41.132965 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-3aa16f98-8228-46dd-a960-c4a2d45ba478 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0390387 Jan 05 15:14:41.227956 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-101d6ff5-e760-4cc2-aa8d-0f4e1fee0004 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:41.230323 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-101d6ff5-e760-4cc2-aa8d-0f4e1fee0004 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1098 time: 0.0432546 Jan 05 15:14:41.331369 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-86b742aa-4e94-4cdf-b6c0-c26f7e65ab4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:41.332825 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-86b742aa-4e94-4cdf-b6c0-c26f7e65ab4d service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0852909 Jan 05 15:14:41.394609 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-f7575833-a28e-4ce0-a4f4-05c1d6e45658 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 200 len: 1000 time: 0.0564010 Jan 05 15:14:41.440875 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-2da07cb7-fa90-4a15-895a-34bd8567df26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:41.442304 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-2da07cb7-fa90-4a15-895a-34bd8567df26 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0422618 Jan 05 15:14:41.489645 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-19d3f3b8-58b2-4466-a419-8a68c0ca35d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:14:41.491139 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-19d3f3b8-58b2-4466-a419-8a68c0ca35d2 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430872 Jan 05 15:14:41.576582 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-f5b76912-127d-453a-8e1c-69d677eb2c42 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798254 Jan 05 15:14:41.666394 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-fc6e5bae-093b-4ca7-8fe4-46c804503b87 req-d3f22934-ad7a-461a-8e13-b580275e7832 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832760 Jan 05 15:14:52.036263 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:14:58.161796 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-701230c1-298d-4ffb-86c8-2e16a46801ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:00.390555 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a96c4e19-d346-4b32-b13c-71b8dddc198c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:01.875868 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:02.836336 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:03.710433 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:04.487475 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:28.181938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-85cd73a8-95ae-4c79-ab1b-a141e8e622ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:29.084828 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:15:30.377892 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-24a2639e-79c9-4a7c-b451-62ce6b76d186 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:31.869434 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:32.778155 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:33.726457 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:34.452301 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:39.661788 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52768) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:39.812640 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Deleting port 9b277091-d6e0-4f83-839f-8f3f1a979c0c {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:39.812890 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:39.883543 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:39.883866 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:39.896213 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling delete_port for 9b277091-d6e0-4f83-839f-8f3f1a979c0c owned by network:floatingip {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:40.107724 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:40.133054 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event deleted for resources: {'Port': ['ID=9b277091-d6e0-4f83-839f-8f3f1a979c0c,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:40.145816 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.151863 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114655) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:40.209390 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:40.209390 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Floating IP 651899ae-411d-444d-98d2-ef4ec0751712 disassociated (deleted). External IP: 172.37.2.230, port: 113c50f8-3fe6-4232-9abc-c3a1f377fc13. Jan 05 15:15:40.415482 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:15:40.522375 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:15:40.527145 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:40.532117 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:15:40.541714 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:15:40.542348 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:15:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:40.558355 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-9c3ef932-d1b4-4dd2-94f8-2144354187c9 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /v2.0/floatingips/651899ae-411d-444d-98d2-ef4ec0751712 HTTP/1.1" status: 204 len: 168 time: 0.8954916 Jan 05 15:15:40.559051 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:15:40.561452 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-998198ae-e0cb-44e4-b0a3-ab2385b008e1" -d '{"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:15:40.607572 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:15:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 x-openstack-request-id: req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:15:40.607805 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:15:40.608059 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1ba8d711-7863-4eee-a102-90bc23b3e4d5 {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:15:40.609533 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'status': 'completed', 'code': 200} Jan 05 15:15:40.737755 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-3439aeee-4a23-4653-b2f2-53f26fcf5164 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:40.739338 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-3439aeee-4a23-4653-b2f2-53f26fcf5164 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 1098 time: 0.0878546 Jan 05 15:15:40.806979 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:15:40.827985 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-a700cc90-a13d-4782-aa08-39e4cc4c8bed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:40.829772 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-a700cc90-a13d-4782-aa08-39e4cc4c8bed service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0849917 Jan 05 15:15:40.875144 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-a5c28e7b-9973-41ed-baf0-de1e1ada96e2 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13 HTTP/1.1" status: 200 len: 217 time: 0.0392547 Jan 05 15:15:40.933841 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-61e4e527-2377-4e31-9062-ebbe1bb61744 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:40.935785 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-61e4e527-2377-4e31-9062-ebbe1bb61744 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0547018 Jan 05 15:15:41.054461 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-5f9b64ab-b3fe-47d3-8297-8eafaf2a4e3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:41.056011 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-5f9b64ab-b3fe-47d3-8297-8eafaf2a4e3f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0781200 Jan 05 15:15:41.057108 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:10Z', 'revision_number': 1, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:41.087668 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:15:41.091795 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793773d3-cafd-4fe6-beb9-4388fa6363a9 req-58cf0156-6111-44f4-95af-cb9ed854cc4e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:41.094318 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-793773d3-cafd-4fe6-beb9-4388fa6363a9 req-58cf0156-6111-44f4-95af-cb9ed854cc4e tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 945 time: 0.1392906 Jan 05 15:15:41.097686 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:15:41.098304 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:15:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:41.190360 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-793773d3-cafd-4fe6-beb9-4388fa6363a9 req-bcf67d49-80a3-4ad4-bc86-a0b0d8659dc1 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0676887 Jan 05 15:15:41.193772 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-66e4fe80-f40d-441f-a86d-13ae35f44234 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1294975 Jan 05 15:15:41.202183 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:15:41.295372 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-998198ae-e0cb-44e4-b0a3-ab2385b008e1 req-f760e843-67d3-47e3-bb6f-b3d0a5734172 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910389 Jan 05 15:15:41.442443 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:10Z', 'revision_number': 1, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:41.474053 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b7ed228-99c4-476f-87e8-57f94a25000f None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_floatingips': [{'id': 'fc407f55-932f-41f2-9ba5-eeba6d64b0b8', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'floating_ip_address': '172.37.2.73', 'floating_network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'router_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'port_id': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'mac_address': 'fa:16:3e:bd:2f:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-01-05T15:12:08Z', 'updated_at': '2022-01-05T15:12:10Z', 'revision_number': 1, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:15:41.686898 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57bba424-f407-40dc-93e2-2b9cb232fad8 None None] New status for floating IP 651899ae-411d-444d-98d2-ef4ec0751712: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:15:42.357312 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 req-032c7551-1bb7-44f2-92a4-2bb9cb2b6057 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:42.358760 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 req-032c7551-1bb7-44f2-92a4-2bb9cb2b6057 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 945 time: 0.0989950 Jan 05 15:15:42.405527 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-34b4d15b-d3dc-4f54-b063-e7d24988efe5 req-ca7da2cf-d137-482f-87b3-b12128e525b0 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406709 Jan 05 15:15:42.731467 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-7cbe6237-a13d-485a-9a75-df4b9afa6bf3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:42.732935 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-7cbe6237-a13d-485a-9a75-df4b9afa6bf3 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 945 time: 0.0485115 Jan 05 15:15:42.824127 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Deleting port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:42.824382 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:42.909403 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] For port 113c50f8-3fe6-4232-9abc-c3a1f377fc13, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=113c50f8-3fe6-4232-9abc-c3a1f377fc13,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:15:42.909758 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:42.922122 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling delete_port for 113c50f8-3fe6-4232-9abc-c3a1f377fc13 owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:43.097812 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:43.123730 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event deleted for resources: {'Port': ['ID=113c50f8-3fe6-4232-9abc-c3a1f377fc13,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:43.135833 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.136186 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.136575 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.136916 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.137281 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.137609 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.137947 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.138276 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.138605 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.138931 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.139350 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.139567 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.139896 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114654) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:43.178434 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] No DVR routers for this DVR port 113c50f8-3fe6-4232-9abc-c3a1f377fc13 on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:15:43.180877 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:43.184149 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-37d2dc06-bb7b-4fc8-a156-a731b93faf63 req-170b2c9a-fa39-4039-b512-799d169bc647 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "DELETE /v2.0/ports/113c50f8-3fe6-4232-9abc-c3a1f377fc13 HTTP/1.1" status: 204 len: 173 time: 0.4455116 Jan 05 15:15:43.184582 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'name': 'network-vif-deleted', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:15:43.186839 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2ccf36c-c4f3-4737-a694-0a8449247998" -d '{"events": [{"server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "name": "network-vif-deleted", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:15:43.232195 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:15:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50911d98-77be-46ed-8584-14cb27c503fd x-openstack-request-id: req-50911d98-77be-46ed-8584-14cb27c503fd {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:15:43.232195 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c", "name": "network-vif-deleted", "tag": "113c50f8-3fe6-4232-9abc-c3a1f377fc13", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:15:43.232195 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-50911d98-77be-46ed-8584-14cb27c503fd {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:15:43.232195 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c', 'name': 'network-vif-deleted', 'tag': '113c50f8-3fe6-4232-9abc-c3a1f377fc13', 'status': 'completed', 'code': 200} Jan 05 15:15:43.499103 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-2e098ce3-0d1a-4ede-a7f0-8714ad027591 req-2c73b855-fcfd-4a82-a0b1-7a1e31bdb0df tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0260088 Jan 05 15:15:44.611370 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-11a63506-d56e-4e5b-b992-b16571fdaa60 req-5176cb0b-496f-4e33-8fbc-1f5db3c30c28 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6c7bba8-cd8a-4ccc-9217-ab48ce9e9c9c HTTP/1.1" status: 200 len: 210 time: 0.0293906 Jan 05 15:15:46.063646 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 113c50f8-3fe6-4232-9abc-c3a1f377fc13 no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:15:46.083086 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 113c50f8-3fe6-4232-9abc-c3a1f377fc13 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:15:46.083437 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 113c50f8-3fe6-4232-9abc-c3a1f377fc13 not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:15:48.137766 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52818) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:48.293471 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Deleting port f43c0e41-ad1b-44ce-9213-29757a3d028b {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:48.293813 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:48.365493 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:48.365819 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:48.377701 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling delete_port for f43c0e41-ad1b-44ce-9213-29757a3d028b owned by network:floatingip {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:48.604779 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:48.630185 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event deleted for resources: {'Port': ['ID=f43c0e41-ad1b-44ce-9213-29757a3d028b,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:48.691071 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:48.691399 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.db.l3_db [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Floating IP fc407f55-932f-41f2-9ba5-eeba6d64b0b8 disassociated (deleted). External IP: 172.37.2.73, port: 5fd3adff-46db-4f6c-976b-1c61edeb54cb. Jan 05 15:15:48.886907 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:15:48.995585 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:15:49.000823 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:49.010754 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:15:49.023407 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:15:49.024031 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:15:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:49.033052 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-225da412-5824-452e-b86a-fa01b139d630 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /v2.0/floatingips/fc407f55-932f-41f2-9ba5-eeba6d64b0b8 HTTP/1.1" status: 204 len: 168 time: 0.8941040 Jan 05 15:15:49.033806 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb'}] {{(pid=114655) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:15:49.036797 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}bffdfba962dc3de5a0ef665b16d3cf877c514f022fac9472e424742992295bc0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93c213c5-3231-4123-aa21-fbe050f1d68c" -d '{"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]}' {{(pid=114655) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:15:49.073902 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 05 Jan 2022 15:15:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19835338-90c2-4605-9d27-3b552da6d567 x-openstack-request-id: req-19835338-90c2-4605-9d27-3b552da6d567 {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:15:49.074318 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb", "status": "completed", "code": 200}]} {{(pid=114655) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:15:49.074574 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-19835338-90c2-4605-9d27-3b552da6d567 {{(pid=114655) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:15:49.074975 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'status': 'completed', 'code': 200} Jan 05 15:15:49.133307 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:15:49.159387 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-ac7fb4d4-e976-466e-a3f4-faac6dd009a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:49.159955 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-ac7fb4d4-e976-466e-a3f4-faac6dd009a3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=4ed05f9412d9477ea62f75cd05af148b&device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 1098 time: 0.0403125 Jan 05 15:15:49.248834 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-319b5cc6-a506-4044-b793-3d2fcec5ce37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:49.250365 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-319b5cc6-a506-4044-b793-3d2fcec5ce37 service neutron] 10.222.0.13 "GET /v2.0/networks?id=b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 200 len: 911 time: 0.0837996 Jan 05 15:15:49.295772 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-2f80d61f-8b77-4806-b244-b017a33201b6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 200 len: 217 time: 0.0388854 Jan 05 15:15:49.339421 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:49.344442 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-e2705445-5b82-4d05-af51-74bb38cf9d60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:49.346037 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-e2705445-5b82-4d05-af51-74bb38cf9d60 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 200 len: 849 time: 0.0441699 Jan 05 15:15:49.371654 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:15:49.380279 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:15:49.380891 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:15:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:49.394926 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-3475156f-69e7-42a3-80ea-3d10a01a433b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:49.396484 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-3475156f-69e7-42a3-80ea-3d10a01a433b service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=b2bf0812-1bb3-4cbd-8030-193c492fed7f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0448716 Jan 05 15:15:49.449677 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40d10d1a-6e5c-422d-b203-0fa478e9d339 req-c013eda3-77f2-4f47-8818-ef7a179cfb15 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114655) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:49.451350 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-40d10d1a-6e5c-422d-b203-0fa478e9d339 req-c013eda3-77f2-4f47-8818-ef7a179cfb15 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 945 time: 0.0489929 Jan 05 15:15:49.499157 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:15:49.510625 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-40d10d1a-6e5c-422d-b203-0fa478e9d339 req-90786b9b-e666-4c78-b8fe-c37c1945a83b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523672 Jan 05 15:15:49.510826 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-d2c3fdec-7f9e-4217-84bc-f34b34060a82 service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883412 Jan 05 15:15:49.600821 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-93c213c5-3231-4123-aa21-fbe050f1d68c req-e4e77091-cc73-4416-9c1f-e228934b73fd service neutron] 10.222.0.13 "GET /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827777 Jan 05 15:15:49.703534 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:49.733262 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fe03d95-5777-4388-8573-d918e3ed81ec None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:08:51Z', 'revision_number': 4, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi', '_interfaces': [{'id': 'c44620a0-1161-4c55-aaa8-b10782655b55', 'name': '', 'network_id': 'b2bf0812-1bb3-4cbd-8030-193c492fed7f', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'mac_address': 'fa:16:3e:a9:42:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_interface', 'standard_attr_id': 666, 'fixed_ips': [{'subnet_id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:50Z', 'updated_at': '2022-01-05T15:08:54Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'subnets': [{'id': '4edb11eb-ca12-4d58-bf53-1c547357436d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:15:49.937789 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61955454-759c-4543-a9e7-f9fa752d2d61 None None] New status for floating IP fc407f55-932f-41f2-9ba5-eeba6d64b0b8: DOWN {{(pid=114657) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jan 05 15:15:50.627472 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0eb783-11aa-448f-b49d-007ce0b8df41 req-2b64a849-41b2-4015-94e6-6836e96e4191 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:50.628987 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cd0eb783-11aa-448f-b49d-007ce0b8df41 req-2b64a849-41b2-4015-94e6-6836e96e4191 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 945 time: 0.0488229 Jan 05 15:15:50.680373 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-cd0eb783-11aa-448f-b49d-007ce0b8df41 req-ba7212b1-9573-423b-82d1-dbbc8fea8392 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/security-groups?id=a2c3d224-9c0a-4ff5-980a-10e9592f96c9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459294 Jan 05 15:15:51.094830 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-0f9854e6-013c-4387-a207-ee4c143baeb6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=114654) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jan 05 15:15:51.096178 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-0f9854e6-013c-4387-a207-ee4c143baeb6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 945 time: 0.0477493 Jan 05 15:15:51.180187 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Deleting port 5fd3adff-46db-4f6c-976b-1c61edeb54cb {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:51.180526 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:51.268104 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] For port 5fd3adff-46db-4f6c-976b-1c61edeb54cb, host hv-cinder-maste, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5fd3adff-46db-4f6c-976b-1c61edeb54cb,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:15:51.268462 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:51.281237 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling delete_port for 5fd3adff-46db-4f6c-976b-1c61edeb54cb owned by compute:nova {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:51.532685 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:51.561261 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event deleted for resources: {'Port': ['ID=5fd3adff-46db-4f6c-976b-1c61edeb54cb,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:51.601414 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.db.l3_dvrscheduler_db [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] No DVR routers for this DVR port 5fd3adff-46db-4f6c-976b-1c61edeb54cb on host hv-cinder-maste {{(pid=114654) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:15:51.603870 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for port, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:51.607168 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-2fb3344f-20a7-4d9f-889e-29a7c10c7476 req-071d25ac-71ee-4b84-a7c7-bcdb07ef63eb tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.13 "DELETE /v2.0/ports/5fd3adff-46db-4f6c-976b-1c61edeb54cb HTTP/1.1" status: 204 len: 173 time: 0.5058360 Jan 05 15:15:51.607606 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'name': 'network-vif-deleted', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb'}] {{(pid=114654) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jan 05 15:15:51.609827 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a02deb677d4867252eba35cf49a33e5c021b9deb09c95baaa195a46fe28c09e5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b8a27df-44d5-41ef-bc7d-6cafc3770e37" -d '{"events": [{"server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "name": "network-vif-deleted", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb"}]}' {{(pid=114654) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jan 05 15:15:51.644071 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 05 Jan 2022 15:15:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fcf63b4-abe3-4a01-8429-305eff62ba0b x-openstack-request-id: req-1fcf63b4-abe3-4a01-8429-305eff62ba0b {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jan 05 15:15:51.644635 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7fa3a7a-27e0-4b5d-a172-1af7d87cde71", "name": "network-vif-deleted", "tag": "5fd3adff-46db-4f6c-976b-1c61edeb54cb", "status": "completed", "code": 200}]} {{(pid=114654) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jan 05 15:15:51.644635 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1fcf63b4-abe3-4a01-8429-305eff62ba0b {{(pid=114654) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jan 05 15:15:51.644983 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7fa3a7a-27e0-4b5d-a172-1af7d87cde71', 'name': 'network-vif-deleted', 'tag': '5fd3adff-46db-4f6c-976b-1c61edeb54cb', 'status': 'completed', 'code': 200} Jan 05 15:15:51.775814 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [req-30bff43c-d90d-48e7-8af4-05e635480ea3 req-baa44829-5604-4a56-bec5-f3fc3829ce6f tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 210 time: 0.0265305 Jan 05 15:15:52.879633 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [req-b22ca1ca-5a29-4746-9364-6dc2866bbe2a req-c551d4d9-ec47-4ff6-abf3-81d0611d914b tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "GET /v2.0/ports?device_id=f7fa3a7a-27e0-4b5d-a172-1af7d87cde71 HTTP/1.1" status: 200 len: 210 time: 0.0253451 Jan 05 15:15:53.933493 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52836) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:54.079656 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Deleting port 1d5a6bb2-0728-4f8c-b715-f56fd1ac8625 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:54.079994 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:54.090365 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 5fd3adff-46db-4f6c-976b-1c61edeb54cb no longer exists at agent hyperv_hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:15:54.111578 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] No Port match for: 5fd3adff-46db-4f6c-976b-1c61edeb54cb {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:15:54.111958 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Device 5fd3adff-46db-4f6c-976b-1c61edeb54cb not bound to the agent host hv-cinder-maste {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:15:54.158337 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:54.158567 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:54.169815 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Calling delete_port for 1d5a6bb2-0728-4f8c-b715-f56fd1ac8625 owned by network:floatingip {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:54.360927 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:54.386053 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event deleted for resources: {'Port': ['ID=1d5a6bb2-0728-4f8c-b715-f56fd1ac8625,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:54.443726 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for floatingip, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:54.446252 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254953'] for floatingip, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:54.447394 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-362907cb-4421-484d-b272-53a9ea353284 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /v2.0/floatingips/f019abae-0b32-4a7c-84ce-6821087fe812 HTTP/1.1" status: 204 len: 168 time: 0.5129266 Jan 05 15:15:55.748123 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52848) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:55.802455 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-97d4ae9c-e9b1-4df5-a027-46b63eaf7af6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:55.826728 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-97d4ae9c-e9b1-4df5-a027-46b63eaf7af6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:55.943003 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-97d4ae9c-e9b1-4df5-a027-46b63eaf7af6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:55.945615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-97d4ae9c-e9b1-4df5-a027-46b63eaf7af6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:55.950902 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-97d4ae9c-e9b1-4df5-a027-46b63eaf7af6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] 10.222.0.30 "DELETE /v2.0/security-groups/a2c3d224-9c0a-4ff5-980a-10e9592f96c9 HTTP/1.1" status: 204 len: 168 time: 0.1977093 Jan 05 15:15:55.956869 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d4ae9c-e9b1-4df5-a027-46b63eaf7af6 tempest-TestVolumeBootPattern-1146057007 tempest-TestVolumeBootPattern-1146057007-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2c3d224-9c0a-4ff5-980a-10e9592f96c9,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:56.060423 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52852) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:56.764156 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:57.002971 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Deleting port c44620a0-1161-4c55-aaa8-b10782655b55 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:57.003310 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:57.080253 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] For port c44620a0-1161-4c55-aaa8-b10782655b55, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c44620a0-1161-4c55-aaa8-b10782655b55,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:15:57.080551 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:57.092460 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Calling delete_port for c44620a0-1161-4c55-aaa8-b10782655b55 owned by network:router_interface {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:57.330198 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:57.355712 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=c44620a0-1161-4c55-aaa8-b10782655b55,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:57.525287 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:57.726888 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114655) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:15:57.826870 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114655) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:15:57.832351 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5503eb3f-963b-4054-86da-c8f860ed90b2 admin admin] 10.222.0.30 "PUT /v2.0/routers/48ecabb4-e81a-4e10-9be8-f0c8dafe3995/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7710021 Jan 05 15:15:57.834919 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52856) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:57.837370 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] Sync routers for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:15:57.848806 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:15:57.849427 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:15:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:57.935726 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks [] for router, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:57.954325 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: dv-cinder-master-3-iscsi {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:15:58.037466 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.140255 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Deleting port f99d056f-803f-40aa-a291-1a136c991838 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:58.140593 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.145194 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198'}], 'enable_snat': True}, 'gw_port_id': 'f99d056f-803f-40aa-a291-1a136c991838', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:15:57Z', 'revision_number': 5, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port': {'id': 'f99d056f-803f-40aa-a291-1a136c991838', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:d6:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'device_owner': 'network:router_gateway', 'standard_attr_id': 665, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:48Z', 'updated_at': '2022-01-05T15:08:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:58.172118 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] Checking router: 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 for host: dv-cinder-master-3-iscsi {{(pid=114656) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:15:58.181400 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] Routers {'48ecabb4-e81a-4e10-9be8-f0c8dafe3995'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114656) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:15:58.182040 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:15:30Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'], 'active': True} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:58.184948 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ac1c9bc0-86b1-4be2-b5ae-a3167ea597e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.220277 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] For port f99d056f-803f-40aa-a291-1a136c991838, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f99d056f-803f-40aa-a291-1a136c991838,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:15:58.220665 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.232184 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Calling delete_port for f99d056f-803f-40aa-a291-1a136c991838 owned by network:router_gateway {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:58.401457 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvr_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] Set router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 gateway port host: None {{(pid=114656) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:15:58.456107 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_hamode_db [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:15:58Z', 'revision_number': 6, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:58.475029 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.482704 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b430fcce-af16-417c-bd10-4f05ca769c2c None None] The sync data for ids ['48ecabb4-e81a-4e10-9be8-f0c8dafe3995'] in dv-cinder-master-3-iscsi is: [{'id': '48ecabb4-e81a-4e10-9be8-f0c8dafe3995', 'name': 'tempest-TestVolumeBootPattern-85557414-router', 'tenant_id': '4ed05f9412d9477ea62f75cd05af148b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:47Z', 'updated_at': '2022-01-05T15:15:58Z', 'revision_number': 6, 'project_id': '4ed05f9412d9477ea62f75cd05af148b', 'gw_port_host': None}] {{(pid=114656) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:15:58.500739 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Pushing event deleted for resources: {'Port': ['ID=f99d056f-803f-40aa-a291-1a136c991838,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:58.564057 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.649534 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.651773 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.772169 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.772716 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 48ecabb4-e81a-4e10-9be8-f0c8dafe3995 {{(pid=114655) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:15:58.778782 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] Publish callbacks [] for router, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.778782 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-609bd647-9680-4eb9-bb30-6a4b4289a033 admin admin] 10.222.0.30 "DELETE /v2.0/routers/48ecabb4-e81a-4e10-9be8-f0c8dafe3995 HTTP/1.1" status: 204 len: 168 time: 0.9423583 Jan 05 15:15:58.780747 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52858) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:58.824703 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] Deleting subnet 4edb11eb-ca12-4d58-bf53-1c547357436d {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:15:58.828580 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.866423 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:58.945117 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.044759 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.070254 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4edb11eb-ca12-4d58-bf53-1c547357436d,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:59.073786 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.076935 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d34594c3-6c1f-4819-bb9e-b2673ed5cac6 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/4edb11eb-ca12-4d58-bf53-1c547357436d HTTP/1.1" status: 204 len: 168 time: 0.2952313 Jan 05 15:15:59.079508 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52860) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:59.080609 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dadb34f5-6f27-4fca-b7ca-7331216fc4bb None None] Network b2bf0812-1bb3-4cbd-8030-193c492fed7f requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:15:59.149571 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.206632 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Deleting port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:59.206979 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.229127 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] DHCP port deletion for b2bf0812-1bb3-4cbd-8030-193c492fed7f request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:15:59.271761 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] For port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:15:59.272173 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.277799 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Deleting port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:15:59.278244 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.284576 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Calling delete_port for 1bc44907-cc1e-4c5e-835d-e74411d2b8fe owned by network:dhcp {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:59.346134 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] For port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,segment=NetworkSegment(101c0dad-0651-4b26-b7e8-40146cbcf385),segment_id=101c0dad-0651-4b26-b7e8-40146cbcf385)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:15:59.346535 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.359938 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Calling delete_port for 1bc44907-cc1e-4c5e-835d-e74411d2b8fe owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:15:59.441197 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.448522 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.473739 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Pushing event deleted for resources: {'Port': ['ID=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:59.477330 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] No DVR routers for this DVR port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe on host dv-cinder-master-3-iscsi {{(pid=114655) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:15:59.479422 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Pushing event deleted for resources: {'Port': ['ID=1bc44907-cc1e-4c5e-835d-e74411d2b8fe,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:15:59.485772 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] No DVR routers for this DVR port 1bc44907-cc1e-4c5e-835d-e74411d2b8fe on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.500854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.501673 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.501673 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.502083 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fce940f2-ad6e-48e2-bc60-b128074e5c76 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-master-3-iscsi {{(pid=114656) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jan 05 15:15:59.555979 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.575516 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b2bf0812-1bb3-4cbd-8030-193c492fed7f']}} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:59.584479 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '101c0dad-0651-4b26-b7e8-40146cbcf385') {'for_net_delete': True} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:59.584780 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '101c0dad-0651-4b26-b7e8-40146cbcf385') {} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:15:59.594564 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4701328'] for segment, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.607094 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.613443 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=114655) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:15:59.613824 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4698958'] for segment, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: Traceback (most recent call last): Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: timer() Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: cb(*args, **kw) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: return func(*args, **kwargs) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: self._notify() Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: self.callback(batched_events) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: event.method(event) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: return f(self, *a, **k) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: return self._get(url).json() Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: return self.request(url, 'GET', **kwargs) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:15:59.615442 dv-cinder-master-3-iscsi neutron-server[114655]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:15:59.726323 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.731730 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:15:59.735514 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] 10.222.0.30 "DELETE /v2.0/networks/b2bf0812-1bb3-4cbd-8030-193c492fed7f HTTP/1.1" status: 204 len: 168 time: 0.6550956 Jan 05 15:15:59.738668 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 52862) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:15:59.751802 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9f1f20-3e31-457c-8d19-afce086c0fcf admin admin] Pushing event deleted for resources: {'Network': ['ID=b2bf0812-1bb3-4cbd-8030-193c492fed7f,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:00.067668 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-713696'] for router_interface, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:00.300787 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Deleting port 8abed7e2-daac-4fa3-af28-a301fb6ca12d {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:16:00.301030 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:00.376116 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] For port 8abed7e2-daac-4fa3-af28-a301fb6ca12d, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8abed7e2-daac-4fa3-af28-a301fb6ca12d,segment=NetworkSegment(63fc6b61-cca5-4ebe-ba1f-8b8860b029e9),segment_id=63fc6b61-cca5-4ebe-ba1f-8b8860b029e9)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:16:00.376486 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:00.377660 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1585002a-744b-418b-ad2a-0cd4c928a26d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:00.389412 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Calling delete_port for 8abed7e2-daac-4fa3-af28-a301fb6ca12d owned by network:router_interface {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:16:00.425182 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device c44620a0-1161-4c55-aaa8-b10782655b55 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:16:00.448541 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: c44620a0-1161-4c55-aaa8-b10782655b55 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:16:00.448887 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device c44620a0-1161-4c55-aaa8-b10782655b55 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:16:00.449334 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 1bc44907-cc1e-4c5e-835d-e74411d2b8fe no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:16:00.468759 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 1bc44907-cc1e-4c5e-835d-e74411d2b8fe {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:16:00.469116 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 1bc44907-cc1e-4c5e-835d-e74411d2b8fe not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:16:00.469530 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f99d056f-803f-40aa-a291-1a136c991838 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:16:00.488735 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: f99d056f-803f-40aa-a291-1a136c991838 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:16:00.489300 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device f99d056f-803f-40aa-a291-1a136c991838 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:16:00.646032 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:00.672523 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Pushing event deleted for resources: {'Port': ['ID=8abed7e2-daac-4fa3-af28-a301fb6ca12d,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:00.833029 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1030187', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-713588'] for router_interface, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:01.287117 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Router b871035c-7095-4390-8b45-783b4fcedacd has already been hosted by L3 agent 53aa3f46-815d-441b-8d28-76ae1ecc6b4f {{(pid=114654) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Jan 05 15:16:01.388973 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] Notify agent at l3_agent.dv-cinder-master-3-iscsi the message routers_updated {{(pid=114654) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Jan 05 15:16:01.394039 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-a10306fd-67ff-4445-8d3a-0ad7e0271d1d admin admin] 10.222.0.30 "PUT /v2.0/routers/b871035c-7095-4390-8b45-783b4fcedacd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6542523 Jan 05 15:16:01.396554 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [-] (114654) accepted ('10.222.0.30', 52864) {{(pid=114654) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:16:01.397387 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] Sync routers for ids ['b871035c-7095-4390-8b45-783b4fcedacd'] in dv-cinder-master-3-iscsi {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jan 05 15:16:01.409505 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] Routers {'b871035c-7095-4390-8b45-783b4fcedacd'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:16:01.410116 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:16:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b871035c-7095-4390-8b45-783b4fcedacd'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:16:01.503270 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks [] for router, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:01.516595 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] Set router b871035c-7095-4390-8b45-783b4fcedacd gateway port host: dv-cinder-master-3-iscsi {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:16:01.603919 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:01.688473 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'external_fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222'}], 'enable_snat': True}, 'gw_port_id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:16:00Z', 'revision_number': 5, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port': {'id': '6cbe9e56-59b3-4632-a4e2-33bae465598c', 'name': '', 'network_id': '5a23f40f-adea-4ffc-bf9d-36fc05b21ca9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:39:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'ip_address': '172.37.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-master-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-01-05T15:08:55Z', 'updated_at': '2022-01-05T15:09:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bdce404c-f51c-4d0a-956e-f48c632a0324', 'cidr': '172.37.2.0/24', 'gateway_ip': '172.37.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-master-3-iscsi'}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:16:01.747997 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Deleting port 6cbe9e56-59b3-4632-a4e2-33bae465598c {{(pid=114654) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:16:01.748338 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:01.801560 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] Checking router: b871035c-7095-4390-8b45-783b4fcedacd for host: dv-cinder-master-3-iscsi {{(pid=114657) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jan 05 15:16:01.810231 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] Routers {'b871035c-7095-4390-8b45-783b4fcedacd'} bound to L3 agent in host dv-cinder-master-3-iscsi {{(pid=114657) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Jan 05 15:16:01.810840 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-master-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-01-05T14:51:00Z,description=,heartbeat_timestamp=2022-01-05T15:16:00Z,host='dv-cinder-master-3-iscsi',id=53aa3f46-815d-441b-8d28-76ae1ecc6b4f,load=0,resource_versions=,resources_synced=,started_at=2022-01-05T14:51:01Z,topic='l3_agent')) {'router_ids': ['b871035c-7095-4390-8b45-783b4fcedacd'], 'active': True} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:16:01.827990 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.db [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] For port 6cbe9e56-59b3-4632-a4e2-33bae465598c, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6cbe9e56-59b3-4632-a4e2-33bae465598c,segment=NetworkSegment(eadfff16-a9dd-467f-8d2f-7ca3a3571fcf),segment_id=eadfff16-a9dd-467f-8d2f-7ca3a3571fcf)] {{(pid=114654) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:16:01.828350 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:01.840694 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.plugins.ml2.plugin [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Calling delete_port for 6cbe9e56-59b3-4632-a4e2-33bae465598c owned by network:router_gateway {{(pid=114654) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:16:01.867460 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:01.895192 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_dvr_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] Set router b871035c-7095-4390-8b45-783b4fcedacd gateway port host: None {{(pid=114657) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Jan 05 15:16:01.946798 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.l3_hamode_db [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:16:01Z', 'revision_number': 6, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port_host': None}], 'dv-cinder-master-3-iscsi', False) {} {{(pid=114657) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:16:01.975822 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bc28f64-2dfa-4a76-99c0-2e8c070c65ab None None] The sync data for ids ['b871035c-7095-4390-8b45-783b4fcedacd'] in dv-cinder-master-3-iscsi is: [{'id': 'b871035c-7095-4390-8b45-783b4fcedacd', 'name': 'tempest-TestVolumeBootPattern-1006874219-router', 'tenant_id': '27c841a04bb44a3cae004da17444831e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-01-05T15:08:54Z', 'updated_at': '2022-01-05T15:16:01Z', 'revision_number': 6, 'project_id': '27c841a04bb44a3cae004da17444831e', 'gw_port_host': None}] {{(pid=114657) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jan 05 15:16:02.067483 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8859506'] for port, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.096793 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Pushing event deleted for resources: {'Port': ['ID=6cbe9e56-59b3-4632-a4e2-33bae465598c,revision_number=None']} {{(pid=114654) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:02.163013 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-714134'] for router_gateway, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.242460 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-713276', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-29979'] for router, precommit_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.244588 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.353099 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-713269'] for router, after_delete {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.358199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b871035c-7095-4390-8b45-783b4fcedacd {{(pid=114654) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Jan 05 15:16:02.358199 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron_lib.callbacks.manager [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] Publish callbacks [] for router, before_response {{(pid=114654) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.362033 dv-cinder-master-3-iscsi neutron-server[114654]: INFO neutron.wsgi [None req-455d6830-5cac-4302-9227-afc8a3562040 admin admin] 10.222.0.30 "DELETE /v2.0/routers/b871035c-7095-4390-8b45-783b4fcedacd HTTP/1.1" status: 204 len: 168 time: 0.9645061 Jan 05 15:16:02.363261 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52866) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:16:02.415455 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.db_base_plugin_v2 [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] Deleting subnet 1d5581de-8632-4b05-b9b6-2aa5d45476b7 {{(pid=114655) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Jan 05 15:16:02.418500 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.452051 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4701343'] for subnet, precommit_delete_associations {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.525977 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-4161166'] for subnet, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.627409 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-4157565', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-635318', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4701356', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4267365'] for subnet, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.663834 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1d5581de-8632-4b05-b9b6-2aa5d45476b7,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:02.663834 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] Publish callbacks [] for subnet, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.665848 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-78acb7fa-14cb-4de3-a7f9-6d14afbf3d3d admin admin] 10.222.0.30 "DELETE /v2.0/subnets/1d5581de-8632-4b05-b9b6-2aa5d45476b7 HTTP/1.1" status: 204 len: 168 time: 0.3004630 Jan 05 15:16:02.666864 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5aff3c83-2dd2-49a4-98ca-87f046e6e246 None None] Network 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 requested from dv-cinder-master-3-iscsi {{(pid=114656) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Jan 05 15:16:02.668141 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52868) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:16:02.748108 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-4105062'] for network, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.797579 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 8abed7e2-daac-4fa3-af28-a301fb6ca12d no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:16:02.818683 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Deleting port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 {{(pid=114655) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:16:02.819029 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.821469 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 8abed7e2-daac-4fa3-af28-a301fb6ca12d {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:16:02.821882 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 8abed7e2-daac-4fa3-af28-a301fb6ca12d not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:16:02.824234 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.849432 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] DHCP port deletion for 077dbc4f-d2ad-421e-98ea-6ea73bbf1021 request from dv-cinder-master-3-iscsi {{(pid=114656) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Jan 05 15:16:02.888422 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.db [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] For port 9dc6509e-d962-4409-a8ef-5494b3ff8a64, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9dc6509e-d962-4409-a8ef-5494b3ff8a64,segment=NetworkSegment(63fc6b61-cca5-4ebe-ba1f-8b8860b029e9),segment_id=63fc6b61-cca5-4ebe-ba1f-8b8860b029e9)] {{(pid=114655) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:16:02.888805 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.899124 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] Deleting port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 {{(pid=114656) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Jan 05 15:16:02.899650 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783776181032'] for port, before_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.901748 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.plugin [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Calling delete_port for 9dc6509e-d962-4409-a8ef-5494b3ff8a64 owned by network:dhcp {{(pid=114655) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:16:02.965548 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.db [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] For port 9dc6509e-d962-4409-a8ef-5494b3ff8a64, host dv-cinder-master-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9dc6509e-d962-4409-a8ef-5494b3ff8a64,segment=NetworkSegment(63fc6b61-cca5-4ebe-ba1f-8b8860b029e9),segment_id=63fc6b61-cca5-4ebe-ba1f-8b8860b029e9)] {{(pid=114656) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Jan 05 15:16:02.965942 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-543943'] for port, precommit_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:02.980554 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] Calling delete_port for 9dc6509e-d962-4409-a8ef-5494b3ff8a64 owned by network:dhcp {{(pid=114656) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Jan 05 15:16:03.038552 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4699003'] for port, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.056450 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-4135468', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-178877', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783776005623', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783775604646'] for port, after_delete {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.067155 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] No DVR routers for this DVR port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 on host dv-cinder-master-3-iscsi {{(pid=114655) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:16:03.070763 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Pushing event deleted for resources: {'Port': ['ID=9dc6509e-d962-4409-a8ef-5494b3ff8a64,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:03.083709 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] Pushing event deleted for resources: {'Port': ['ID=9dc6509e-d962-4409-a8ef-5494b3ff8a64,revision_number=None']} {{(pid=114656) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:03.085495 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab2851aa-9f57-4a72-8a13-9586a3c360bd None None] No DVR routers for this DVR port 9dc6509e-d962-4409-a8ef-5494b3ff8a64 on host dv-cinder-master-3-iscsi {{(pid=114656) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jan 05 15:16:03.145426 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-4160521', 'neutron.services.segments.db._delete_segments_for_network-8783776153146'] for network, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.165213 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['077dbc4f-d2ad-421e-98ea-6ea73bbf1021']}} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:16:03.174018 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9') {'for_net_delete': True} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:16:03.174312 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.services.segments.db [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '63fc6b61-cca5-4ebe-ba1f-8b8860b029e9') {} {{(pid=114655) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jan 05 15:16:03.183421 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783776158275', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4701328'] for segment, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.196025 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411'] for segment, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.201730 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Releasing vlan 109 on physical network physnet1 to pool {{(pid=114655) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jan 05 15:16:03.202615 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-4159411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4698958'] for segment, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: Traceback (most recent call last): Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: timer() Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: cb(*args, **kw) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: return func(*args, **kwargs) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: self._notify() Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: self.callback(batched_events) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: event.method(event) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_id = self._get_aggregate_id(event.segment_id) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: aggregate_uuid = self.p_client.list_aggregates( Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: return f(self, *a, **k) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: return self._get(url).json() Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: return self._client.get(url, endpoint_filter=self._ks_filter, Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: return self.request(url, 'GET', **kwargs) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: base_url = self.get_endpoint(auth, allow=allow, Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: auth = self._auth_required(auth, 'determine endpoint URL') Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jan 05 15:16:03.204220 dv-cinder-master-3-iscsi neutron-server[114655]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jan 05 15:16:03.324351 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-4160512', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1030178', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-714226'] for network, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.329137 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1030196'] for network, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.332442 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] 10.222.0.30 "DELETE /v2.0/networks/077dbc4f-d2ad-421e-98ea-6ea73bbf1021 HTTP/1.1" status: 204 len: 168 time: 0.6633675 Jan 05 15:16:03.346071 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5544cf5f-c171-45b1-a7a1-dc5d31c5c11f admin admin] Pushing event deleted for resources: {'Network': ['ID=077dbc4f-d2ad-421e-98ea-6ea73bbf1021,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:03.638541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52872) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:16:03.678135 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-d739a6bd-9544-4750-9ead-7de0c178581c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4ed05f9412d9477ea62f75cd05af148b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384414 Jan 05 15:16:03.680541 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52874) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:16:03.725816 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c0355ab-5024-45d7-a685-64694498b322 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.735620 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.745708 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c0355ab-5024-45d7-a685-64694498b322 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.857037 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c0355ab-5024-45d7-a685-64694498b322 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.859718 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-1c0355ab-5024-45d7-a685-64694498b322 admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:03.860950 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-1c0355ab-5024-45d7-a685-64694498b322 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4f998e68-33a5-440b-9104-322c45733a9c HTTP/1.1" status: 204 len: 168 time: 0.1794729 Jan 05 15:16:03.868535 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0355ab-5024-45d7-a685-64694498b322 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f998e68-33a5-440b-9104-322c45733a9c,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:04.416604 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6cbe9e56-59b3-4632-a4e2-33bae465598c no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:16:04.436912 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 6cbe9e56-59b3-4632-a4e2-33bae465598c {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:16:04.450499 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 6cbe9e56-59b3-4632-a4e2-33bae465598c not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:16:04.450499 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 9dc6509e-d962-4409-a8ef-5494b3ff8a64 no longer exists at agent ovs-agent-dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Jan 05 15:16:04.450499 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:04.457893 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.plugin [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] No Port match for: 9dc6509e-d962-4409-a8ef-5494b3ff8a64 {{(pid=114656) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Jan 05 15:16:04.458250 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron.plugins.ml2.rpc [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Device 9dc6509e-d962-4409-a8ef-5494b3ff8a64 not bound to the agent host dv-cinder-master-3-iscsi {{(pid=114656) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Jan 05 15:16:04.524436 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52880) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:16:04.563422 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-4bdd5278-a035-4a95-9def-21e7a2bf61f1 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=27c841a04bb44a3cae004da17444831e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0377614 Jan 05 15:16:04.565852 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [-] (114655) accepted ('10.222.0.30', 52882) {{(pid=114655) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Jan 05 15:16:04.614905 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0b8bff40-c3ab-4e13-b2ee-7118ef6413ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:04.635974 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0b8bff40-c3ab-4e13-b2ee-7118ef6413ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:04.742981 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0b8bff40-c3ab-4e13-b2ee-7118ef6413ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-631525'] for security_group, after_delete {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:04.745515 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron_lib.callbacks.manager [None req-0b8bff40-c3ab-4e13-b2ee-7118ef6413ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=114655) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:04.746655 dv-cinder-master-3-iscsi neutron-server[114655]: INFO neutron.wsgi [None req-0b8bff40-c3ab-4e13-b2ee-7118ef6413ab admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/641d876c-6fe1-4bf0-acd5-b0fbb0eb56e1 HTTP/1.1" status: 204 len: 168 time: 0.1798792 Jan 05 15:16:04.757603 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8bff40-c3ab-4e13-b2ee-7118ef6413ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=641d876c-6fe1-4bf0-acd5-b0fbb0eb56e1,revision_number=None']} {{(pid=114655) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jan 05 15:16:06.033738 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:16:28.165248 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-b86b7920-cbfd-4f14-8e4f-9de4a44ab44c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:30.376398 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5fffb4ae-9622-43f1-8e66-eac545cca434 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:31.885023 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:32.786451 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:33.742340 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:34.410648 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:16:43.032389 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:16:58.198660 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-13fd0df4-b35d-43ae-8c71-a796fa02ce77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:00.387319 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f12f4044-38e5-4375-90d2-774d5ece83f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:01.876896 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:02.793048 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:03.724735 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:04.444087 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:13.675879 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [req-e84a5c85-acbd-4ff8-b67a-a6e524bc147f req-fd2aea9f-39a2-405f-8ca2-6399fe3dd909 tempest-VolumesActionsTest-1476342834 tempest-VolumesActionsTest-1476342834-project] (114655) timed out ('10.222.0.13', 56438) {{(pid=114655) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Jan 05 15:17:20.030871 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:17:28.192361 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f50dd3b0-278e-4b12-a75f-e7c0d2d98525 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:30.361588 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5dd2227f-3c43-43f1-9e6a-8c6212d0220e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:31.904561 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:32.803461 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:33.746098 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:34.431748 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:17:57.030094 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:17:58.207958 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-854ecd50-6f06-466a-b624-93082ae8b76e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:00.363163 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a63af49a-81db-45f0-b7ae-647e456c8094 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:01.876674 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:02.829595 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:03.739378 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:04.436975 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:28.213345 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a9e19714-9054-4fb3-aae4-fca410df3276 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:30.377959 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-527864a9-2c07-43ba-bb3c-1be015f7adbb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:31.885598 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:32.807493 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:33.727257 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:34.030169 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:18:34.424746 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:18:58.183803 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-932e1d1b-9d3f-4cae-8949-50959ad552ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:00.405182 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-6eef069f-19d8-4839-8a1f-f0787d645675 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:01.919232 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:02.821806 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:03.760714 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:04.417947 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:11.028523 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:19:28.198624 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-f7de7c5e-4120-42e0-b64f-2b8d047c4cb0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:30.382611 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-7e622bba-7671-443b-bd3c-4076f331d503 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:31.891291 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:32.798490 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:33.725753 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:34.434255 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:19:48.026914 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:19:58.197535 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-2f76d1db-df7d-4352-8e43-2b136a52339d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:00.368854 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-06b8053e-f782-4d0f-aba2-ec9d93eb5a75 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:01.890970 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:02.815963 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:03.718722 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:04.427443 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:25.025390 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:20:28.214143 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-57d3b0e9-a91e-4f94-820c-e7cb0ab35b97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:30.369423 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5e432612-643c-408c-9e1a-149b6a9cb946 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:31.918551 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:32.827016 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:33.757900 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:34.421151 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:20:45.481047 dv-cinder-master-3-iscsi neutron-server[114655]: DEBUG neutron.wsgi [req-17ffab96-2400-48c7-a52f-ef753d1ec9ee req-d3a9912e-ccfb-400c-99c2-152e4f2c2c0a service neutron] (114655) timed out ('10.222.0.30', 46232) {{(pid=114655) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Jan 05 15:20:58.190148 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-39caf940-5718-42ee-a284-fcc3ad527035 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:21:00.357730 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-279293af-b415-44fa-8593-44d7fcfecdae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:21:01.905945 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-5d201d22-ff97-460f-b0d5-835103dae572 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:21:02.024511 dv-cinder-master-3-iscsi neutron-server[114657]: DEBUG neutron.db.agents_db [None req-82965ade-06f0-487c-b959-bc87fef62286 None None] Agent healthcheck: found 6 active agents {{(pid=114657) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Jan 05 15:21:02.809324 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-a4ec12c1-1128-4ae6-b424-e6ededf207d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:21:03.740804 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-09cf67b3-3f70-47bf-aa4c-091a9693e02e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:21:04.430024 dv-cinder-master-3-iscsi neutron-server[114656]: DEBUG neutron_lib.callbacks.manager [None req-1b3d09fa-b903-417e-9eb5-27c54f599290 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783776153128', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-4154179'] for agent, after_update {{(pid=114656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Jan 05 15:21:22.693016 dv-cinder-master-3-iscsi neutron-server[114654]: DEBUG neutron.wsgi [req-883fd817-7f22-41ad-9516-37b8e9cc195d req-cb60456e-1ecd-4c73-85db-523ddd4c3076 service neutron] (114654) timed out ('10.222.0.30', 50080) {{(pid=114654) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}}